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PREFACE 


This  study  was  prompted  by  a  pulse  position/amplitude 
estimation  problem  of  a  pulse  position  modulation  receiver 
operating  well  below  threshold.  The  receiver  suffers  from 
extensive  anamolous  pulse-position  errors  while  guaranteeing 
a  minimum  probability  of  detection  for  the  signal  pulse. 


TABLE  OF  CONTENTS 


Page 

Acknowledgements  .  i 

Preface  .  .....  .  ii 

Table  of  Contents  . . iii 

List  of  Figures  . . v 

Abstract  .  .........  x 

I.  Introduction . 1 

Background  .  5 

Amplitude  Estimation  Problem  .........  6 

Scope  and  Assumptions .  8 

Over  vi  . .  10 

II.  Theoretical  Background .  11 

Receiver  Structure  .  11 

Signal  Model  .....  .  ....  23 

Markov  Process  . . 25 

Birth-Death  Process  ...........  31 

M/M/K//M  Model  .  33 

Viterbi  Algorithm  . .  35 

Trellis  . . 36 

Decision  Depth  .........  .  44 

III.  Estimator  Simulation  . . 47 

Simulation  Setup  .  .......  47 

Software  .................  47 

Signal  Set  ...........  .  48 

Parameter  Variation  ..  .  50 

Transition  Probability  Values  .  51 

Sensitivity  . . 56 

Simulation  Results  .....  .  58 

Confidence  of  sample  Statistics  .....  58 

Performance  Measures  .  .  60 

Estimator  Performance  .  62 

Model  Sensitivity . 97 

Rate  Sensitivity . 106 

Signal  Set  Performance  .  114 

Comments . 114 


IV.  Conclusions  and  Recommendations  .  117 

Conclusions  ......  .  ...  117 

Recommendations  for  Further  Study  .  .  120 

Bibliography . 123 

Appendix  A  -  Poisson  Channel . 125 

Appendix  B  -  Samples  of  Quantized  Versions  of  the 

Assumed  Message  Set . 136 

Appendix  C  -  Sample  Estimations  . .  158 

Appendix  D  -  Expanded  Trellis . .  250 


LIST  OF  FIGURES 


FIGURE 


TITLE 


PAGE 


Ideal  PPM  Signal  3 

PPM  Signal  With  Noise  4 

Received  Signal  After  Transmission  Through  5 

Noisy  Medium  With  Multiple  Anamolous 
Errors 

An  Ideal  Signal  as  it  Leaves  the  Transmitter  7 

Received  Noisy  PPM  Signal  With  Multiple  7 

Anamolous  Errors 

Detection  of  Modulated  Pulse  12 

Quantized  Ideal  PPM  Frame  13 

General  ROC  Curves  17 

Discrete  Channel  Model  17 

Intersymbol  Pulse  Interference  19 

General  Channel  Mode  21 

Discrete  Vector  Channel  Model  22 

General  Transition  Diagram  27 

State  Transition  Diagram  -  Markov  Process  30 

State  Representation  36 

Trellis  Representation  of  State  Transitions  37 

Number  of  Runs  59 

Ensemble  Average  MSS  Performance  64 

Ensemble  Average  State  Error  Performance  65 

Ensemble  Average  MSE  Performance  66 


Ensemble  Average  State  Error  Performance 


FIGURE  TITLE  PAGE 

22  Ensemble  Average  MSE  Performance  68 

23  Ensemble  Average  State  Error  Performance  69 

24-32  Sample  Estimation  -  Depth  =  5  71-79 

33  Performance  Comparison  83 

34  Ensemble  Average  MSE  Performance  86 

35  Ensemble  Average  State  Error  Performance  87 

36  Ensemble  Average  MSE  Performance  88 

37  Ensemble  Average  State  Error  Performance  89 

38  <C  PS >  Versus  Depth,  Vary  <^ZCR  >  ,  90 

Number  of  Samples 

39  Ensemble  Average  MSE  Performance  92 

40  Ensemble  Average  State  Error  Performance  93 

41-43  Sample  Estimation  -  Performance  Improvement  94-96 

44-45  Model  Sensitivity  -  Pure  Birth  Statistics  98-99 

46-47  Model  Sensitivity  -  Pure  Death  Statistics  100-101 

48-49  Model  Sensitivity  -  Pure  Birth  Statistics  102-103 

50-51  Model  Sensitivity  -  Pure  Death  Statistics  104-105 

52  Ensemble  Average  MSE  Performance  -  Random  107 

Rate  Parameter 

53  Ensemble  Average  State  Error  Performance  -  108 

Random  Rate  Parameter 

54  Ensemble  Average  MSE  Performance  -  Random  109 

Rate  Parameter 

55  Ensemble  Average  State  Error  Performance  -  110 

Random  Rate  Parameter 

56  Ensemble  Average  MSE  Performance  -  Random  111 

Rate  Parameter 

57  Ensemble  Average  State  Error  Performance  -  112 

Random  Rate  Parameter 


FIGURE 


TITLE 


* 

R 


4 


4 


PAG  E 


58 

Rate  Sensitivity  Comparison 

113 

59 

Message  Performance  Comparison 

116 

60 

Sample  Poisson  Density  Function  -  Low 
Count  Rite 

127 

61A/B 

Low  Count  Model /High  Count  Model 

128 

62 

RC  Impulse  Response 

129 

63 

Inter-occurrence  Time 

130 

64-83 

Sample  Message  Sequence 

138-157 

84-87 

Sample  Estimation 

160-163 

88 

Ensemble  Average  MSE  Performance 

164 

89 

Ensemble  Average  State  Error  Performance 

165 

90-94 

Sample  Estimation 

166-170 

95 

Ensemble  Average  MSE  Performance 

171 

96 

Ensemble  Average  State  Error  Performance 

172 

97 

Ensemble  Average  MSE  Performance 

173 

98 

Ensemble  Av- /age  State  Error  Performance 

174 

99-103 

Sample  Estimation 

175-179 

104 

Ensemble  Average  MSE  Performance 

180 

105 

Ensemble  Average  State  Error  Performance 

181 

106-110 

Sample  Estimation 

182-186 

111 

Ensemble  Average  MSE  Performance 

187 

112 

Ensemble  Average  State  Error  Performance 

188 

113-116 

Sample  Estimation 

189-192 

117 

Ensemble  Average  MSE  Performance 

193 

118 

Ensemble  Average  State  Error  Performance 

194 

4 


figure: 

TI TL  3 

PAG  E 

119-123 

Sample  Estimation 

195-199 

124 

Ensemble  Average  MSE  Performance 

200 

125 

Ensemble  Average  State  Error  Performance 

201 

126-129 

Sample  Estimation 

202-205 

130 

Ensemble  Average  MSE  Performance 

206 

131 

Ensemble  Average  State  Error  Performance 

207 

132-136 

Sample  Estimation 

208-212 

137 

Ensemble  Average  MSE  Performance 

213 

138 

Ensemble  Average  State  Error  Performance 

214 

139-142 

Sample  Estimation 

215-218 

143 

Ensemble  Average  MSE  Performance 

219 

144 

Ensemble  Average  State  Error  Performance 

220 

145-148 

Sample  Estimation 

221-224 

149 

Ensemble  Average  MSS  Performance 

225 

150 

Ensemble  Average  State  Error  Performance 

226 

151-154 

Sample  Estimation 

227-230 

155 

Ensemble  Average  MSE  Performance 

231 

156 

Ensemble  Average  State  Error  Performance 

232 

157-160 

Sample  Estimation 

233-236 

161 

Ensemble  Average  MSE  Performance 

237 

162 

Ensemble  Average  State  Error  Performance 

238 

163-165 

Sample  Estimation 

239-241 

166 

Ensemble  Average  MSE  Performance 

242 

167 

Ensemble  Average  State  Error  Performance 

243 

MSE  Performance 


248 


j  State  Error  Performance 


249 


ABSTRACT 
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( 

The  performance  of  a  pulse  position  modulation  (PPM) 
receiver,  operating  at  a  predetection  signal-to-noise  ratio 
below  threshold,  is  severely  degraded  by  the  occurrence  of 
anamolous  pulses.  The  anamolies  are  caused  by  noise  with 
sufficient  amplitude  to  be  detected  as  a  signal  pulse.  The 
resultant  multiple  threshold  crossings  per  sample  frame 
severely  degrade  the  demodulated  version  of  the  original 
message. 

In  this  report,  a  maximum  a  posteriori  (MAP)  amplitude 
sequence  estimator  is  developed  based  on  the  Viterbi  algorithm. 
The  signal  is  modelled  as  a  finite-state,  discrete-time 
Markov  process.  The  states  correspond  to  the  possible 
positions  within  a  quantized  version  of  the  sample  frame, 
receiver  structure  and  associated  operating  characteristics 
are  presented  in  support  of  the  concept  of  a  quantized  PPM 
frame.  The  pulse  position/amplitude  sequence  is  observed  in 
white  Gaussian  noise,  and  probability  of  detection  for  each 
signal  pulse  is  assumed  equal  to  one. 

Monte  Carlo  simulation  is  used  to  determine  the  average 
performance  of  the  estimator.  The  performance  is  expressed 

r - 

m  terms  of  ensemble  average  mean  square  error,  ensemble 
average  state  estimate  error  and  frequency  of  error.  The 
frequency  of  error  is  termed  the  average  probability  of  error. 
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The  average  probability  is  expressed  with  respect  to  the 
total  average  number  of  threshold  crossings. 

5ach  frame  is  quantized  into  32  pulse  positions.  The 
performance  of  the  estimator  is  presented  for  a  family  of 
six  signals.  The  signal  set  was  selected  arbitrarily  with 
the  only  requirement  for  consideration  being  that  the  signal 
had  to  consist  of  at  least  one  absolute  maximum  during  the 
observation  time. 

The  estimator  is  shown  to  be  able  to  provide  an  accurate 
reconstruction  of  the  original  pulse  posit ion/ampli tude 
sequence  for  the  signals  considered  for  up  to  20  or  23  pulse 
occurrences  per  frame,  depending  on  the  signal.  The  ability 
to  enhance  estimator  performance  by  varying  various  signal 
model  and  algorithm  parameters  is  also  presented.  The 
algorithm  is  shown  to  be  sensitive  to  the  assumed  model 
(model  sensitivity)  but  not  to  the  set  of  transition 
probability  values  (rate  sensitivity)  within  a  given  model. 


I.  INTRODUCTION: 

Pulse  position  modulation  (PPM)  is  one  of  three  analog 
pulse  modulation  techniques:  the  other  two  being  pulse- 
amplitude  modulation  (PAM)  and  pulse-width  modulation  (PWM). 
For  PAM,  a  message  m(t)  is  sampled  and  a  pulse,  with  ampli¬ 
tude  proportional  to  the  sample  value  of  the  message,  is 
transmitted  across  the  channel.  In  both  PWM  and  PPM,  the 
information  resides  in  the  position  of  the  transmitted  pulse 
instead  of  its  amplitude.  Demodulation  of  PWM  or  PPM  is 
accomplished  by  detecting  the  edge  (leading  or  trailing)  of 
the  transmitted  pulse.  Hie  performance  of  PAM  is  essen¬ 
tial  1. ,  equivalent  to  continuous  baseband  transmission  (Ref 
20).  Both  PWM  and  PPM  are  nonlinear  modulation  techniques 
and,  therefore,  performance  is  appropriately  expressed  in 
terms  of  the  signal- to-noise  ratio  (SNR)  -  bandwidth  (BW) 
trade-off  and  threshold  effect  experienced  by  nonlinear 
modulation  techniques. 

For  PPM,  the  instantaneous  amplitude  sample  of  the 
message  m(t),  is  caused  to  vary  the  position  in  time  of 
a  pulse  relative  to  its  unmodulated  time  of  occurrence. 
Compared  to  PWM,  PPM  conserves  signal  power.  A  PPM  pulse 
has  fixed  amplitude  and  fixed  duratiai  and,  therefore, 
the  energy  in  the  transmitted  pulse  is  independent  of  the 
sample  value  of  m(t).  PPM  is  generally  preferred  over  PWM 
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primarily  for  this  reason  and  is  generally  used  when  band¬ 
width  is  not  at  a  premium  for  such  applications  as  multi¬ 
plexing  telephone  channels  or  transmission  of  some  types 
of  guidance  and/or  telemetry  data. 

A  PPM  receiver  generally  uses  a  threshold  method  of 
detection  and  demodulation.  The  receiver  threshold  is  set 
to  detect  an  expected  pulse  amplitude  within  a  sample  or 
frame  time.  The  occurrence  time  of  an  unmodulated  pulse  is 
frequently  referred  to  as  the  frame  marker.  The  occurrence 
time  of  a  modulated  pulse  is  determined  by  the  time  the 
modulated  pulse  is  detected  (crossing  the  threshold).  The 
time  is  measured  with  respect  to  the  frame  marker.  The 
demodulation  of  a  PPM  signal  is  simply  a  mapping  of  occur¬ 
rence  times  into  amplitudes.  In  the  absence  of  noise,  the 
receiver  maps  the  time  of  the  threshold  crossing  into  a 
unique  amplitude  value.  PPM  can  be  thought  of  as  a  discrete 
time,  continuous  amplitude  modulation  technique.  Figure  1 
depicts  an  ideal,  noise  free  PPM  signal  for  a  single  frame. 

A  characteristic  of  nonlinear  modulation  techniques 
such  as  PPM,  is  the  ability  to  trade-off  bandwidth  and  SNR 
to  enhance  performance.  As  with  all  nonlinear  modulation 
techniques,  PPM  is  vulnerable  to  threshold  effect.  The  point 
at  which  the  post-detection  SNR  falls  off  rapidly  with 
decreasing  predetection  SNR  is  called  the  threshold  (not 
to  be  confused  with  the  detection  threshold).  All  nonlinear 
modulation  techniques  experience  this  threshold.  A 


FIGURE  1.  Ideal  PPM  Signal 

predetection  SNR  below  the  threshold  causes  the  receiver  to 
"break, "  or  lose  the  signal.  The  resulting  severely  degraded 
performance  is  due  to  this  threshold  effect.  It  is  possible 
to  make  trade-offs  between  SNR  and  BW  to  maintain  acceptable 
receiver  performance  as  long  as  the  receiver  remains  above 
the  threshold  value  of  predetection  SNR. 

Errors  in  the  demodulation  of  PPM  signals  occur  in  two 
basic  forms.  The  least  critical  demodulation  error  occurs 
when  the  receiver  operates  above  threshold.  This  type  of 
error  is  a  result  of  the  channel  noise,  n(ti),  causing  a 
net  incremental  shift  in  the  occurrence  time  of  the  modu¬ 
lated  pulse  as  shown  in  Figure  2.  The  noise  causes  the 
receiver  to  detect  the  modulated  pulse  slightly  early  (or 
late)  with  respect  to  the  no-noise  position,  elt^)  in  Figure 
2.  The  error  becomes  more  significant  with  decreasing 


predetection  SNR.  For  low  SNR,  this  error  may  be  minimized 
by  using  a  wider  system  bandwidth  to  allow  for  pulses  with 
faster  rise  time  (smaller  TR  in  Figure  2).  A  sharper  pulse 
reduces  the  effect  the  noise  has  in  producing  the  incremental 
shift  error.  The  SNR-BW  trade-off  is  effective  only  to  a 
point.  The  combination  of  low  predetection  SNR  and  wide 
bandwidth  eventually  forces  the  receiver  to  operate  below 
threshold.  Threshold  effect  in  PPM  produces  the  second,  and 
more  significant  demodulation  error  to  be  referred  to  as 
anamolous  detection  error. 

An  anamolous  error  is  synonymous  with  false  threshold 
crossings.  Ihe  false  threshold  crossings  result  when  noise 

spikes  occur  with  sufficient  amplitude  to  cross  the  receiver 
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threshold.  The  receiver  detects  and  demodulates  multiple 
"pulses"  within  each  frame  instead  of  the  desired  single 
data  pulse.  The  erroneous  threshold  crossings  result  in 
significant  demodulation  (pulse  position)  error.  Figure  3 
shows  an  example  of  anamolous  errors  within  a  single  frame. 


FIGURE  3.  Received  Signal  After  Transmission  Through  Noisy 
Medium  With  Multiple  Anamolous  Errors 

BACKGROUND; 

The  PPM  system  under  study  essentially  operates  close 
to  or  below  threshold.  Anamolous  errors  are  caused  by  the 
low  SNR,  wide  bandwidth  combination.  The  extent  of  anamolous 
error  is  exacerbated,  however,  by  the  need  to  guarantee 
detection  of  the  actual  data  pulse  within  each  frame.  The 
detection  threshold  is  set  low  enough  to  provide  a  proba¬ 
bility  of  detection,  p  =1.0  for  the  actual  data  pulse.  rhe 
number  of  anamolies  is  the  result  of  the  low  predetection 
SNR,  wide  BW,  and  low  detection  threshold. 
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A  fix  designed  to  minimize  the  effect  of  the  anamolous 
errors  is  to  place  the  receiver  in  a  mode  in  which  the  first 
threshold  crossing  within  a  frame  constitutes  the  pulse 
occurrence  time  and  all  other  threshold  crossings  within 
that  frame  are  ignored  (Ref  15).  This  mode  is  referred  to 
as  frame  lock-out.  The  subject  receiver  instead,  detects 
and  demodulates  all  threshold  crossings  within  each  frame. 
Unlike  the  frame  lock-out  method,  this  mode  of  operation 
provides  the  desired  probability  of  detection  assuming  the 
detection  threshold  is  set  appropriately. 

A  system  that  either  does  not  suffer  from  anamolous 
errors  or  that  employs  the  aforementioned  fix  will  map  the 
demodulated  pulse  position  into  a  single  amplitude  value. 

A  typical  mapping  is  given  in  Figure  4.  The  given  PPM 
system  maps  each  threshold  crossing  into  an  amplitude  value. 
This  results  in  an  output  consisting  of  multiple  amplitude 
values  versus  discrete  sample  times  as  seen  in  Figure  5. 

It  is  obvious  that  some  form  of  reliable  single  point  data 
is  desirable  over  the  resultant  multipoint  data. 

AMPLITUDE  ESTIMATION  PROBLEM: 

As  described  previously,  the  combination  of  low  SNR, 
wide  bandwidth  and  receiver  mode  of  operation  adversely 
affects  the  task  of  amplitude  estimation  (single  point 
amplitude  mapping  of  the  detected  threshold  crossings). 

The  basic  problem  is  the  reconstruction  of  the  original 


Pulse  Position  Time  3  Pulse  Position  Time 


message.  Assuming  the  receiver  mode  cannot  be  changed,  an 
automated  signal  processing  technique  is  desired  to  convert 
the  multipoint  PPM  data  to  single  point  data  with  a  high 
level  of  confidence  that  the  edited  data  accurately  recon¬ 
structs  the  original  message  signal. 

Hie  problem  will  be  approached  as  a  pulse  position/ 
amplitude  estimation  problem.  Hie  amplitude  estimator 
utilized  in  this  thesis  is  one  which  produces  the  maximum 
a  posteriori  (MAP)  estimate  of  a  signal  amplitude  sequence. 
Actual  computation  of  the  MAP  amplitude  sequence  employs  the 
Viterbi  Decoding  Algorithm  (backward  dynamic  programming) 
(Ref  18). 

SCOPE  AND  ASSUMPTIONS: 

In  this  thesis,  the  amplitude  sequence  of  the  message 
signal  will  be  modelled  as  a  first  order  Markov  process. 

A  special  case  discrete  time  Markov  process  will  be  pre¬ 
sented  as  a  suitable  signal  model.  Hie  channel  is  assumed 
to  be  memoryless  and  additive.  Hie  Viterbi  algorithm, 
therefore,  provides  a  MAP  estimate  if  and  only  if  Markov 
signal  and  memoryless  channel  constraints  are  met.  Both 
Guassian  and  Poisson  channel  models  will  be  considered. 
Amplitude  estimation  will  be  made  on  a  sample- by-sample 
basis  based  on  quantized  versions  of  an  assumed  set  of 
signals.  Hie  significance  of  providing  a  quantized  estimate 
will  be  presented  later. 


Actual  signal  power  and  noise  power  are  unavailable 
and,  therefore,  system  performance  will  be  expressed  in  terms 
of  probability  of  estimator  error  (to  be  described  later), 
ensemble  average  estimator  error,  and  ensemble  average 
mean-square  error  with  respect  to  a  zero  crossing  ratio 
(also  to  be  defined  later). 

Assuming  a  receiver  operating  mode  that  produces  numerous 
anamolies  per  frame,  exact  message  reconstruction  is  assumed 
unattainable.  Additionally,  if  erroneous  threshold  crossings 
do  not  exist  (i.e..  operation  well  above  threshold),  conven¬ 
tional  PPM  detection  and  demodulation  are  sufficient  with 
demodulation  errors  attributable  to  incremental  shift 
phenomena  only.  This  thesis  is  concerned  with  presenting 
a  signal  model,  a  channel  model(s),  and  an  automated  esti¬ 
mation  technique  that  together  will  provide  a  reasonable 
reconstruction  of  a  transmitted  message  that  has  been  dis¬ 
torted  by  the  channel  and  receiver  mode  as  described.  This 
thesis  does  not  attempt  to  provide  an  all  encompassing 
improvement  in  methodology  in  detecting  and  demodulating 
PPM  signals.  The  automation  process  (MAP  estimator)  pre¬ 
sented  in  this  thesis  is  presented  as  an  alternative  to  the 
frame  lock-out  technique  in  reducing  the  affect  these 
anamolies  have  on  demodulation.  This  approach  differs  from 
the  upcrossing  receiver  (Kef  13:307)  in  that  the  upcrossing 
receiver  assumes  a  high  SNR  and  low  probability  of  anamoly 


occurrence.  The  upcrossing  receiver  is  a  maximum  likelihood 
receiver  designed  to  minimize  incremental  shift  errors 
experienced  when  operating  above  threshold  and  no  large 
anamolous  errors  exist. 

Lastly,  the  limits  on  the  application  of  the  estimator 
will  be  identified.  A  limiting  point  will  be  identified, 
at  which  given  the  signal  model  parameters,  Viterbi  algorithm 
parameters,  and  the  assumed  message  set,  a  high  degree  of 
confidence  in  signal  reconstruction  is  no  longer  attainable. 

OVERVIEW; 

This  report  begins  with  a  description  of  the  underlying 
system  constraints  and  the  nature  of  the  amplitude  estimation 
problem.  Chapter  II  presents  the  receiver  structure  and 
operating  characteristics  necessary  to  allow  for  this  approach 
to  the  problem.  The  signal  amplitude  seguence  model,  a  Markov 
process  model,  is  presented  as  well  as  the  algorithm  for  a 
MAP  amplitude  sequence  estimator  using  the  Viterbi  algorithm. 

A  discussion  of  the  algorithm  simulation  and  the  results 
achieved  are  presented  in  Chapter  III.  Finally,  conclusions 
are  reviewed  and  recommendations  for  further  study  are  pre¬ 
sented  in  Chapter  IV. 


II 


THEJORUTI CAL  BACKGROUND: 


In  this  chapter,  the  theoretical  background  of  the 
MAP  amplitude  sequence  estimator  is  presented.  The  chapter 
is  divided  into  three  sections.  The  first  section  presents 
the  receiver  structure  and  operating  characteristics.  The 
second  section  provides  a  brief  discussion  on  Markov  pro¬ 
cesses,  and  presents  the  Markov  model  used  for  the  discrete 
representation  of  the  signal.  The  amplitude  sequence  esti¬ 
mation  is  performed  via  the  Viterbi  algorithm.  The  third 
section  of  the  chapter  presents  an  expression  (path  metric) 
to  be  used  recursively  to  solve  the  estimation  problem  and 
a  discussion  of  the  application  of  the  algorithm  to  this 
estimation  problem. 

RFCUIVFR  STRUCTURE: 

A  conventional  PPM  system  detects  the  occurrence  of  a 
pulse  during  a  specified  frame  or  sample  time  by  threshold 
crossing  detection.  The  receiver  may  be  designed  to  detect 
the  leading  edge,  trailing  edge,  or  peak  of  the  pulse  within 
each  frame  time.  The  frame  is  "marked"  by  two  stationary 
pulses  called  frame  markers.  rhe  markers  are  the  unmodulated 
pulse  positions  in  time.  The  receiver  threshold,  K,  is 
generally  set  at  one  half  the  expected  pulse  amplitude  (Ref 
15).  A  typical  frame  is  depicted  in  Figure  6. 


FIGURE  6.  Detection  of  Modulated  Pulse 

As  depicted,  the  time  t,  at  which  the  receiver  detects 
the  threshold  crossing,  is  demodulated  or  mapped  into  a 
unique  amplitude  value.  The  range  of  amplitude  values 
depends  upon  the  frame  time.  It  is  desirable  to  represent 
this  continuum  of  amplitudes  in  a  discrete/quantized  form, 
which  in  turn,  reflects  a  quantized  version  of  each  frame 
time.  Reasons  for  this  quantization  will  be  presented  in 
the  next  section. 

It  is  necessary  to  propose  a  new  receiver '-structure 
based  on  quantized  signal  amplitudes  and,  therefore,  also 
quantized  pulse  positions.  The  frame  time  T,  is  divided 
into  M  uniform  intervals  of  time.  These  M  intervals  repre¬ 
sent  M  possible  pulse  positions.  Consequently,  the  M 


intervals  also  represent  M  possible  signal  amplitudes.  rhe 
demodulator  mapping  is  now  one  of  discrete  amplitude  versus 


1 

1 


discrete  sample  time.  The  M  intervals  are  independent 
observation  intervals  or  "bit  times."  A  threshold  crossing 
within  a  bit  time  is  represented  by  a  "1"  and  no  threshold 
crossing  within  a  bit  time  is  represented  by  a  "0."  Figure 
7  shows  an  example  of  a  sample  frame  subdivided  into  M=16, 
pulse  position  intervals.  Ifrese  16  possible  pulse  positions 
are  mapped  by  the  demodulation  into  16  amplitude  levels. 

The  16  intervals  define  a  16  bit  word.  The  word  in  Figure 
7  would  be  0000001000000000. 


« 


FIGURE  7.  Quantized  Ideal  PPM  Frame 
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frame  may  then  be 


represented  as  an  M-dimensional  vector: 


where  each  element  represents  the  threshold  crossings 
(0  or  1)  for  the  i*"*1  bit  time.  If  the  sampling  is  further 
assumed  to  be  uniform,  each  frame  represents  one  of  N, 
independent  samples.  The  receiver  may  now  be  modelled  as 
processing  a  sequence  of  N,  M-dimensional,  independent 
vectors.  Each  vector  Z ^  is  defined  as  an  observation  vector. 

Using  the  conventional  notation  for  an  additive 
channel,  the  system  may  be  represented  in  vector  form  as: 

Z  =  5  +  n  (2) 

where  Z  is  the  observation  vector,  S  is  some  signal  vector, 
and  n  represents  the  noise  due  to  the  channel.  The  signal 
vector  must  now  be  defined. 

A  signal  vector  is  defined  as  an  M-dimensional  vector 
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composed  of  all  zero  elements  except  for  a  single  element 


SK  *  1  (4) 

t  h 

corresponding  to  a  pulse  in  the  K1"  position.  The  message 
m(t),  may  now  be  expressed  as  sequence  of  N,  M-dimensional 
signal  vectors: 


N 

m(t)  =  £  S  $(t-jT)  (5) 

j=l 

where  each  is  an  element  of  the  set  of  M  possible  signal 
vectors  corresponding  to  the  M  possible  pulse  positions.  A 
more  complete  form  of  equation  (5)  is: 


N 

m(t)  =T  S1.  (j>(  t— jT)  i  -  1.  2 . M  (6) 

2=1  J 


where  <[>(t)  is  the  orthogonal  basis  set  with  dimension  M 
formed  by  the  M  possible  pulse  positions.  The  signal  set  3 
is  defined  as: 

S  =[s1,  s2 . SM]  (7) 

where: 
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Before  defining  the  noise  vector  n,  the  receiver  operating 
characteristics  must  be  highlighted. 

The  receiver  operates  in  what  must  be  called  a  "less 
than  optimum"  manner.  Factors  affecting  receiver  perform¬ 
ance  are  bandwidth,  SNR,  and  the  threshold  setting.  The 
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bandwidth  is  excessively  wide  in  order  to  allow  for  a  wide 
range  of  signal  pulse  rise  times.  The  predetection  SNR 
is  known  to  be  very  low  (less  than  OdB).  The  threshold 
setting  is  not  fixed  in  this  receiver.  The  threshold  is 
set  to  guarantee  detection  of  the  signal  pulse  with  the 
probability  of  detection,  PQ  =  1.0  for  all  frame  times. 

The  low  SNR,  wide  bandwidth,  and  low  threshold  setting  places 
the  receiver  in  a  regime  where  the  largest  demodulation  error 
is  due  to  erroneous  threshold  crossings  caused  by  the  noise 
(Ref  13,  15,  19). 

In  terms  of  classical  receiver  operating  character¬ 
istics  (ROC),  the  region  of  operation  may  be  seen  graphically 
on  a  family  of  ROC  curves  (Ref  7).  The  ROC  curves  of  Figure 
8  represent  general  receiver  operating  characteristics  on 
a  bit  time  basis.  In  Figure  8,  PpA  is  the  probability  of 
false  alarm  or  the  probability  that  in  a  single  bit  time, 
a  threshold  crossing  will  occur  given  that  the  signal  pulse 

was  not  sent  in  that  interval.  The  range  of  Pn,  for  each 

FA 

of  the  ROC  curves  is  depicted  by  the  line  segments  AX,  BX, 

CX,  and  DX  in  Figure  8.  Again,  on  bit  time  basis,  the 
system  may  be  represented  in  terms  of  a  discrete  channel 
model  with  bit  crossover  probabilities  as  depicted  in 
Figure  9.  In  Figure  9,  denotes  the  i th  bit  time  in  a 
frame  that  is  transmitted,  and  the  i th  observed  bit 
.  The  transition  probabilities  P (z^  |x^ )  are  simply: 


time 


1.0 


Equation  (10)  merely  demonstrates  that  given  a  particular 

P„.  as  determined  by  the  receiver  threshold  and  the  channel 
FA 

statistics,  a  figure  of  anamoly  or  measure  of  anamolous 
error  is  available. 

To  complete  the  discussion  of  the  receiver  structure, 
assumptions  regarding  bit  times  must  be  made.  A  complete 
summary  of  the  receiver  is  also  included  in  this  paragraph. 
The  assumptions  regarding  bit  times  pertain  only  to  eliminat¬ 
ing  or  minimizing  any  concern  for  demodulation  errors  other 
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than  those  attributable  to  multiple  anamolies.  First,  the 
quantization  of  frame  times  into  bit  intervals  allows  for 


sufficient  guard  time.  This  assumption  minimizes  the  effect 
of  intersymbol  interference  in  that  a  pulse  in  frame  KT 
will  not  carry  over  into  frame  (K+1)T.  Figure  10  depicts 


FIGURE  10.  Intersymbol  Pulse  Interference 


Secondly,  during  a  single  bit  time,  only  one  threshold 
crossing  (pulse)  may  be  observed.  A  pulse,  noise  or  signal, 
is  assumed  to  exist  completely  within  a  given  bit  time. 

Ibis  assumption  eliminates  any  concern  for  any  interbit 
interference. 

The  second  assumption  is  fundamental  to  describing  the 

receiver  mode  of  operation.  The  receiver  mode  is  best 
referred  to  as  a  "bit  lock-out"  mode  of  operation.  That  is, 

one  and  only  one  pulse  may  be  detected  per  bit  interval. 
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The  first  threshold  crossing  per  bit  interval  constitutes  the 
detection  of  a  pulse  within  that  observation  interval.  All 
other  threshold  crossings  within  that  observation  interval 
are  ignored.  The  "bit  lock-out"  mode  applies  to  each  of  the 
M  observation  intervals  per  frame. 

Lastly,  in  addition  to  guaranteeing  the  existence  of 
the  actual  data  pulse  within  each  frame,  the  original  quan¬ 
tized  pulse  position  is  also  preserved.  A  "1"  transmitted 
in  the  ith  bit  position,  will  be  detected  in  the  ith  bit 
position.  This  assumption  is  in  addition  to  the  probability 
of  detection,  PQ  =  1.0  requirement.  The  receiver  structure 
is  best  summarized  as  follows: 

(1)  The  receiver  makes  M  independent  threshold 
observations  per  frame  time. 

(2)  One  threshold  crossing  per  M  observations  must 
be  the  signal  pulse  with  its  position  preserved  over  the 
channel. 

(3)  Interbit  and  intersymbol  interference  are 
negligible. 

Before  proceeding  with  the  next  section,  the  last  term 
of  (2)  must  be  defined.  It  is  convenient  to  rewrite  (2) 
as : 


Z  =  3 .  +  e  . 

-i  ~3 


(11 


where  Z  and  3^  are  as  previously  defined  and  is  defined 


as  an  M-dimensional  error  vector  due  to  channel  noise.  Zach 
element  of  e^  is  independent  and,  therefore,  the  set  of  error 
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M 

vectors,  E,  contains  2  vectors: 

a  =  ^e1#  e2,  .  .  .  .  e^j  J  =  2™ 

Equation  (2)  becomes: 

Z  —  +  e  j  i  =  1,  2,  •  •  .  M 


The  system  model  may  be  described  as : 


(12) 


(13) 


FIGURE  11.  General  Channel  Model 

The  adder  in  Figure  11  is  more  accurately  defined  as  an 
OR-ing  device.  The  signal  vector  is  OR-ed  with  the  error 
vector.  Given  a  signal  vector  S^,  the  observation  vector 
Z  may  assume  any  one  of  2^-MH-l  forms.  The  assumption  that 
the  pulse  position  or  1-bit  position  of  the  signal  vector 
is  preserved,  establishes  the  fact  that  a  given  "l"-bit 
position  cannot  be  changed,  therefore,  disallowing  one  signal 
vector  being  changed  to  another  signal  vector,  hence  the 
-(M-l)  term. 
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On  a  frame-by-frame  basis.  Figure  9  expands  to  Figure 

12  representing  the  M-hypothesis ,  2M-M+1  transitions,  and 
M 

2  possible  observations. 


FIGURE  12.  Discrete  Vector  Channel  Model 


By  recalling  independent  bit  times,  the  transition  proba¬ 


bilities  P(Z|X)  may  be  expressed  as: 

M 


PC^IXj)  =  IT  PUj  X±)  (14) 

where  the  P(?-|  X^)  are  the  bit  crossover  probabilities  of 


Figure  9. 


A  receiver  structure  has  been  proposed  in  which  the 
signal  is  assumed  to  be  represented  as  a  finite  state  (ampli¬ 
tude)  sequence.  This  representation  has  been  accomplished 
by  quantizing  the  PPM  frame  times  into  M  uniform  subintervals 
or  bit  times.  The  signal  pulse  may  occupy  one  and  only  one 
of  these  subintervals.  The  receiver  maps  the  jth  bit  time 
into  the  jth  discrete  amplitude.  The  next  section  will 
discuss  the  Markov  signal  model  in  terms  of  the  receiver 
structure. 

SIGNAL  MODEL: 

The  Viterbi  decoding  algorithm  is  indeed  a  maximum- 
likelihood  decoder  and,  therefore,  always  optimum  (Ref  2,  9). 
If  the  signal  to  be  estimated  (with  respect  to  phase,  fre¬ 
quency,  amplitude,  etc.)  is  modeled  as  a  discrete  time, 
finite  state  Markov  process,  in  memoryless  noise,  then  the 
Viterbi  algorithm  is  a  recursive  optimal  solution  to  the 
problem  of  estimating  the  state  sequence  of  the  discrete-time 
finite-state  Markov  process.  Additionally,  this  solution 
may  be  viewed  as  a  solution  to  the  maximum  a  posteriori 
probability  (MAP)  estimation  of  the  state  sequence  (Ref  2). 
The  Viterbi  algorithm  metric  (to  be  defined  later)  uses  a 
form  involving  the  state  transition  probabilities  which 
characterize  a  discrete-time  finite-state  Markov  process 
(Ref  10).  This  section  uses  the  underlying  Markov  require¬ 
ment  as  stated  above,  as  a  starting  point  for  selection  of 
a  suitable  signal  model. 


In  order  to  develop  a  model  of  the  amplitude  sequence, 
it  is  beneficial  to  first  limit  the  type  and  behavior  of  the 
message  signal.  The  message  is  assumed  to  vary  slowly  in 
time.  Frequencies  to  be  expected  range  from  less  than  10 
Hertz  (Hz)  to  at  most  100Hz.  The  signal  is  assumed  to 
represent  physical  phenomenon  that  cannot  change  rapidly 
in  time,  nor  can  it  experience  an  instantaneous  change  in 
performance  values. 

^ previous  section,  a  receiver  structure  was  pro¬ 
posed  to  approximate  the  continuous  amplitude  sequence  as 
a  finite-state,  amplitude  sequence.  The  input  sequence  to 
the  channel  may  be  thought  of  as  a  finite-state-sequence  of 
length  N,  of  M  possible  states.  The  input  sequence  is 
assumed  to  start  at  time  KT,  K=1  and  stop  at  KT,  K=N  where 
K  is  the  sample  of  the  input  sequence.  The  complete 
input  sequence  may  be  represented  as: 

=  (U^,  U^,  .  .  .  U^)  -Vs  j  €  {l.  2, 3.  .  .m|  (15) 

Equation  (15)  describes  the  sequence  of  discrete  pulse 
positions/amplitudes  corresponding  to  some  message  m(t).  To 
implement  the  Viterbi  algorithm  as  a  MAP  estimator,  the  finite 
state,  discrete  time  sequence  must  now  be  expressed  as  a 
first  order  Markov  process. 

In  view  of  the  now  discrete  nature  of  the  system  and 
the  assumed  behavior  of  the  message  m(t),  a  class  of  first 
order  Markov  processes  known  as  birth-death  processes,  was 
selected  for  initial  study.  A  general  discussion  of  Markov 
processes  follows: 


(1)  Markov  Process.  A  process  termed  Markov  is 


generally  described  in  terms  of  a  transition  probability 
distribution  on  the  states  that  compose  the  process  (Ref  3, 
4,  5,  6).  A  process  is  first  order  Markov  in  the  sense 
that  the  probability: 

p{^+iixo'  xi . 4}  (161 

of  being  in  state  X-'  at  time  K+l  given  all  the  states  X1 
up  to  and  including  time  K,  depends  only  on  the  state  X1 
at  time  K.  Equation  (16)  becomes: 

P{*K+liX0'  X1  ***Xk)  =  P{XK+iIXk) 

The  term  on  the  right  side  of  the  equality  is  the  state 
transition  probability  for  state  X1  to  X-*.  The  transition 
probabilities  may  be  time  varying,  however,  for  this  study, 
the  transition  probabilities  are  time  invariant. 

The  transition  probabilities  for  a  Markov  process  may 
be  expressed  in  the  form  of  a  stochastic  matrix: 

P  =  (Pi;j)  (18) 

Each  specifies  the  probability  of  making  a  transition 

from  state  i  to  state  j,  from  one  sample  time  to  the  next. 
For  an  M  state  process,  the  stochastic  matrix  P  has  dimen¬ 
sion  MxM  such  that: 


P.  .  . 

n. 


P.  . 
13. 


(19) 
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where: 

o  S  Pij  i  1  1  —  i  /  j  -  M  (20) 

and: 

M 

£  P.  .  =  1  J  =  1,  2 . M  (21) 

i=l  J 

It  is  important  to  consider  three  qualities  of  the  P 
matrix  in  relation  to  the  finite  state  input  sequence.  First, 
the  P  matrix  is  time  invariant  and,  therefore,  the  process 
is  said  to  be  stationary  (Ref  6).  That  is: 

pjx(K+7)=i |x(N+7)  =  j  |  =  p{x(K)=i  |x(N)  =  j|  N=K- 1  (22) 
The  process  is  said  to  be  irreducible  in  that  all  states 
communicate.  Communicate  means  that  each  state  may  be 
arrived  at  given  enough  time,  independent  of  the  starting 
state.  If  the  P  matrix  was  reducible,  a  given  starting 
state  for  the  signal  process  would  rule  out  some  subset  of 
states.  The  P  matrix  would  vary  depending  on  the  starting 
state.  Sufficient  information  about  a  particular  message 
sequence  may  yield  a  reducible  stochastic  matrix,  however, 
for  this  study,  no  such  prior  information  is  available  and, 
therefore,  the  assumption  that  all  states  communicate  will 
hold.  Lastly,  all  states  are  considered  to  be  transient. 

No  state  is  considered  absorbing: 

p{xa(K)  |Xj(K-l)J  »0  -V"  i  =  l,  2,  .  .  .  M  (23) 

<Vsj=l,2,...  M 

'V'kS  n 

where  N  is  the  last  state  in  the  sequence. 
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The  notion  of  transient  and  absorbing  states  is  better 
understood  in  terms  of  a  state  transition  diagram.  In  addi¬ 
tion  to  a  stochastic  matrix,  an  M-state  Markov  process  may 
be  represented  graphically  by  a  state  transition  diagram 
similar  to  Figure  13. 


FIGURE  13.  General  Transition  Diagram 

The  transition  diagram  resembles  flow  graphs  used  to  des¬ 
cribe  a  finite  state  machine,  with  the  transition  proba- 
bilities,  P^j,  replacing  the  usual  input/output  information. 

Figure  13  shows  an  example  of  both  transient  and 
absorbing  states.  states  #1-44  are  transient  in  that, 
once  any  of  these  states  are  arrived  at,  there  exists  some 
probability  of  leaving  that  state.  state  #5  is  an  absorbing 
state  in  that  once  state  #5  is  arrived  at: 

27 


4 


AAj  *  5 


(24) 
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and: 


=  0 


(25) 


The  process  stays  in  this  state  once  it  is  reached.  "Examples 
of  finite-state  Markov  processes  that  have  both  transient  and 
absorbing  states  are  finite-population  pure  birth  processes 
and  pure  death  processes.  Other  examples  include  the 
gambler's  ruin  chain,  the  absorbing  state  corresponds  to  the 
state  in  which  the  gambler  has  run  cut  of  money  (Ref  3).  The 
assumption  that  no  absorbing  state  exists  does  not  restrict 
the  "behavior"  of  the  process.  A  finite-state  process  with 
no  absorbing  states  may  indeed  reside  in  the  same  state  from 
sample  to  sample.  However,  the  probability  of  making  a 
transition  out  of  this  state  remains  greater  than  zero.  In 
this  manner,  the  Markov  model  used  will  not  restrict  the 
"behavior"  of  the  message  sequence.  The  model  may  be  used 
to  describe  a  message  that  is  periodic  or  a  message  that 
experiences  an  absolute  maximum  or  minimum.  A  Markov  model 
with  an  absorbing  state  might  be  used  to  describe  a  message 
involving  a  known,  steady  state,  constant  value.  A  Markov- 
model  with  only  transient  states  will  be  used  in  an  attempt 
to  describe  a  more  general  message  "behavior." 

As  will  be  demonstrated  in  the  last  section  of  this 
chapter,  the  P  matrix  is  critical  in  implementing  the  viterbi 
algorithm.  The  stationarity  of  the  process  requires  only  one 
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stochastic  matrix  to  be  computed  for  given  sequence.  Param¬ 
eters  used  to  define  a  specific  P  matrix  are  described  next. 

The  assumptions  made  regarding  the  transmitted  message, 
m(t),  makes  the  modelling  of  the  sampled  and  quantized  ver¬ 
sion  of  m(t)  as  a  first  order  Markov  process  intuitively 
satisfying.  Restricting  the  message  behavior  (i.e. ,  rate 
of  change  with  time,  etc. ) ,  ensures  that  the  message  may  be 
sampled  fast  enough  to  ensure  that  a  sample  value  (quantized) 
at  time  KT  is  dependent  only  on  the  sample  value  (quantized) 
at  time  (K-l)T.  Such  a  sample  rate  guarantees  that  a  state 
sequence  based  on  quantized  amplitudes  (discrete  states) 
remains  first  order  Markov  in  its  characteristics.  This 
sample  rate  is  assumed  to  be  achievable  and  will  limit  state 
(Quantized  amplitude)  transitions  for  (K-l)TltiKT  (i.e., 
from  one  sample  time  to  the  next)  to  one  of  the  following 
possibilities : 

(1)  A  transition  may  occur  only  from  a  given 
state  to  one  of  two  adjoining  states,  or 

(2)  No  transition  occurs:  the  process  remains 
in  the  given  state. 

Since  each  state  corresponds  to  a  quantized  amplitude  value, 
the  quantized  version  of  m(t)  may  change  by  at  most  one 
quantization  level  (or  pulse  position  interval)  from  sample 
to  sample.  The  sanple  rate  must  provide  this  limitation. 

The  state  diagram  of  Figure  14  may  be  used  to  describe 
the  Markov  model  and  illustrate  the  adjoining  state  transition 


limitation 
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FIGURE  14.  State  Transition  Diagram  -  Markov  Process 

The  P  matrix  of  equation  (19)  simplifies  to  a  M  x  M  matrix 
with  nonzero  elements  only  on  the  main  and  two  adjoining 
diagonals : 


where: 

0  =  Ptj51  |i- jfel  (27) 

P.  j  =  0 

and : 

M 

I  i-’ii  =  1  j  =  1.2 . M  (28) 

i  =  1  J 

The  restrictions  and  characteristics  presented  thus  far 
reduce  the  signal  model  problem  to  selecting  a  first  order 


Markov  process  that  fits  the  signal  sequence  as  describe! 
by  the  state  diagram  of  Figure  14,  and  the  stochastic  matrix 
P.  The  process  chosen  is  a  special  case  of  discrete  time 
Markov  process  known  as  the  birth-death  process.  Character¬ 
istics  of  the  process  are  presented  next. 

(2)  Birth-Death  Process.  A  birth-death  process  ( BDP ) 
is  a  first  order  Markov  process  used  to  model  changes  in  the 
size  of  a  population  or  que.  For  a  birth-death  process,  the 
system  is  said  to  be  in  state  Xj  when  the  population  consists 
of  J  members.  A  key  assumption  in  a  BDP  is  that  changes  in 
population  size  occur  by  at  most  one  person.  A  "birth"  will 
change  the  population  size  to  one  greater  and  a  "death"  will 
change  the  size  to  one  less.  Multiple  births  or  bulk  disasters 
are  not  permitted.  This  is  merely  the  adjoining  state  premise 
stated  in  equation  (25). 

A  BDP  is  a  homogeneous  (stationary)  process  with  the 
transition  probabilities  defined  as  (.Ref  5): 

j=i-l 

j=i  (29) 

j=i  +  l 
elsewhere 

The  d^  term  represents  the  probability  that  from  one  sample 
time  to  the  next,  a  single  death  will  occur,  thus  driving  the 
population  down  to  i-1  given  the  population  is  at  i.  oimi- 


pij  -{ 


d. 

i 


b. 

1 


larly,  the  b.  term  represents  the  probability  that  single 


birth  will  occur,  thereby  increasing  the  population  size  u.j 
to  i+l  given  it  is  at  size  i  at  the  previous  sample  time. 
Tbe  term  1-b^-ch,  is  the  probability  that  neither  of  these 
events  occur  from  one  sample  time  to  the  next.  Clearly  the 
conditions  of  equations  (25)  and  (26)  hold  for  a  discrete 
time  birth-death  process. 

Two  special  situations  arise  in  a  BDP.  First,  a  death 
is  not  permitted  with  a  population  of  zero.  Additionally, 
contrary  to  intuition,  a  birth  is  allowed  within  a  zero 
population  level.  This  becomes  more  meaningful  when  the 
general  BDP  is  refined  further  to  one  with  specific  transi¬ 
tion  probabilities  (  queing  theory  model).  Specifically: 

d  =  o  b  >*0  (30) 

o  o 

equation  (29)  will  obviously  produce  the  desired  tri¬ 
diagonal  stochastic  matrix.  The  stochastic  matrix  of  equa¬ 
tion  (24)  becomes: 


No  births  are  allowed  once  the  population  has  matured  to  its 
limit  (finite  population  size),  therefore: 


(3)  M/m/K/Ax  Model.  Numerous  derivatives  of  the  general 
class  of  birth-death  processes  exist.  Many  adaptations  to 
the  DDP  are  utilized  in  queing  theory.  One  such  adaptation 
was  chosen  for  the  manner  in  which  it  meets  the  signal 
sequence  assumptions.  The  model,  in  queing  theory  termi¬ 
nology,  is  an  M/M/k//M  queing  model  (Ref  5).  This  model 
describes  a  system  of  finite  customer  population  and  a 
finite  number  of  servers.  For  this  study,  tne  number  of 
servers  is  limited  to  the  same  size  as  the  population. 

The  finite  population  has  as  its  limit  M  customers, 
corresponding  to  M  possible  pulse  positions  per  frame.  The 
population  size  of  the  que  defines  the  state  of  the  process, 
dach  customer  has  an  "arriving"  parameter  \  .  The  system 
also  has  M  servers  available  each  with  a  "serving"  parameter 
yf £.  These  parameters,  \  and  fl  ,  represent  birth  and  death 
rates  per  unit  time  with  respect  to  a  general  BDP.  Before 
proceeding,  it  is  necessary  to  introduce  what  is  called  the 
set  of  birth  death  coefficients. 

Regarding  the  nature  of  births  and  death,  the  notion 
of  a  birth  rate  X  describes  the  rate  at  which  births  occur 

I\ 

when  the  population  is  of  size  K.  Similarly  the  notion  of 
a  death  rate  describes  the  rate  at  which  deaths  occur 
when  the  population  is  of  size  K.  These  rates  do  not  chanae 
with  time;  however,  they  are  a  function  of  the  current  state 
(current  population  size).  Referring  back  to  the  general 
birth-death  process  for  a  moment,  the  transition  probabilities 


of  equation  (27)  may  be  expressed  in  terms  of  the  birth 


and  death  coefficients.  The  probabilities  become: 

b^=Pr  jexactly  1  birth  in  T  secjK  in  pop| 


(33) 


=  K  T 


d^,=Pr  (exactly  1  death  in  T  sec  |k  in  pop) 

=  T 


The  time  T,  is  the  step  time  or  sample  time  of  the  popula¬ 
tion  (que).  A  sample  occurs  every  T  seconds.  The  sample 
time  T  is  assumed  small  enough  to  ensure  that  the  limits  of 
a  transition  are  +1  in  population  size.  This,  in  turn, 
satisfies  the  nearest  neighbor  or  adjoining  state  limitation 
stated  earlier  with  respect  to  the  message  sequence. 

The  sample  interval  T,  is  a  critical  factor  in  the 
application  of  this  model.  A  sample  rate,  f  =l/T,  that 
produces  a  change  of  at  most  one  pulse  position  (from  sample 
to  sample)  is  the  foundation  upon  which  selection  of  a 
particular  Markov  model  rests.  The  "fast"  sample  rate  allows 
the  sequence  to  be  modelled  a  sequence  of  adjoining,  discrete 
amplitude/pulse-position  states.  The  benefits  of  the 
adjoining  state  requirement  will  be  graphically  illustrated 
in  the  next  section  where  the  concept  of  a  trellis  diagram 
is  introduced. 

The  birth-death  coefficients  that  describe  the  finite 


customer  population,  finite  server  model  are  as  follows: 


0  2  K  2  M 


(34) 


0* 


X( M-K ) 

0 


otherwise 


Uk  =  K/U 


K=l,  2 . M 


This  system  is  homogeneous  and  irreducible.  Additionally, 
all  states  are  transient  and  no  state  is  absorbing  (Ref  5). 

The  transition  probabilities  and  hence  the  behavior  of  the 
process  is  completely  specified  in  terms  of: 

(1)  The  arrival  or  birth  rate,  X  (35) 

(2)  The  serving  or  death  rate,  M 

(3)  The  sample  rate,  1/T 

(4)  The  size  of  the  population,  KSM 

These  four  parameters  will  be  used  to  specify  the  signal 
sequence.  The  finite  population  corresponds  to  the  finite 
number  of  pulse  positions,  the  arrival  and  serving  rates 
represent  rates  of  signal  change  per  unit  time,  and  f  =1/ T 
is  the  sampling  rate.  For  a  given  sample  rate  l/T  and  H  pulse 
positions,  the  rate  parameters  will  be  varied  over  a  finite 
range  and  the  adequacy  of  the  model  will  be  observed  in  the 
implementation  of  the  Viterbi  algorithm.  'The  next  section 
deals  with  the  Viterbi  algorithm. 


VI T  -:R3I  a  lgo  r  I THM : 

In  the  previous  section,  the  importance  of  specifying 
the  process  in  terms  of  a  set  of  transition  probabilities 
was  reserved  for  this  section.  This  section  will  establish 
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the  necessary  terms  and  the  importance  of  the  transition 
probabilities  in  implementing  a  MAP  estimator  by  the  Viterbi 
algorithm. 

Hence  forth,  the  state  diagram  of  Figure  14  will  no 
longer  be  used  to  describe  the  amplitude  state  sequence  of 
the  signal.  Instead,  a  new  convention,  the  trellis  diagram, 
will  be  introduced  in  this  section.  The  convention  of  a 
trellis  diagram  is  extremely  useful  when  using  the  Viterbi 
algorithm. 

(1)  Trellis.  In  terms  of  the  discrete  time  BDP  pre¬ 
sented  in  the  previous  section,  a  trellis  diagram  expresses 
the  possible  behavior  of  the  process  for  a  given  starting 
state.  (Also,  see  Appendix  D  for  discussion  of  expanded  trellis) 
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Figure  15  depicts  a  portion  of  a  trellis  for  two  sample 
times  and  three  of  the  M  states.  The  paths  connecting  the 
states  represent  the  possible  transitions  that  the  process 
may  undergo  from  one  sample  to  the  next.  In  terms  of  the 
signal  amplitude  sequence/  X.  represents  one  of  M  amplitud 
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states  and  KT  represents  the  k  sample  time. 
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FIGURG  16.  Trellis  Representation  of  State  Transitions 


Figure  16  shows  a  trellis  representing  a  system  of  four 
states  over  four  sample  times.  Given  the  starting  state 
shown,  the  sequence  will  follow  one  and  only  one  path 
through  the  trellis  based  on  the  definitions  and  assumptions 
presented  in  the  previous  section.  The  correct  path  is 
described  by  equation  (15),  the  input  amplitude  sequence. 
Given  the  transition  probabilities  of  the  sequence  and  the 
observation  vector  Z,  the  Viterbi  algorithm,  in  providing 


the  MAP  estimate  of  the  amplitude  sequence,  will  in  reality. 


be  finding  the  shortest  path  through  the  trellis.  To  find 
the  shortest  path,  the  algorithm  requires  a  metric  to  be 
assigned  to  each  branch. 

Branch  metrics  are  shown  in  Figure  16.  A  branch 
metric: 


Xk  <J-  n  (36> 

is  the  metric  or  distance  from  state  j  to  state  1  given 
the  system  is  in  state  j  at  time  K.  For  convenience,  since 
only  integer  multiples  of  T  are  considered,  each  sample  time 
will  be  expressed  in  terms  of  only  an  integer.  A  path 
through  the  trellis  is  described  in  terms  of  its  length 
by  the  sum  of  its  branches: 


r;' t 

1 

rv-1 


jK(j.  1) 


(37) 


Vs  j  =  1' 2 . M 

-Vs  1  =  1,  2,  .  ...M 
It  is  now  convenient  to  define  the  branch  metrics. 

(2)  Branch  Metric.  The  desired  result  is  an  estimate 


of  the  K*"*1  input  sequence,  w  This  estimate  is  denoted 

W:- 


as 


It  will  be  shown  that  the  RAP  estimate  of  the 


fA  1  n 

amplitude  sequence  is  the  sequence  that  provides  the 

shortest  path  through  the  trellis. 

Forney  (Ref  2)  has  shown  a  one-to-one  correspondence 
to  exist  between  a  state  sequence: 

i*-v- i  i  =  |"-^i  •  •  •  •  •  -Vt]  (  33) 


and  the  transition  seauence: 


€  =  {^-  f2.  ^3 . U 


The  transition  c,.  is  defined  as: 

r 


Ik  "  (xk+i.  V  <4; 

Since  the  process  is  assumed  to  be  observed  in  memoryless 
noise,  there  is  a  sequence  of  observations,  in  whi< 

'■%.  deoends  probabilistically  only  on  the  transition  f.  at 
time  K,  or  that: 

‘  I"  p|>lf4 

r*-l 

A  special  case  of  this  formulation  is  one  in  which  the 
output  of  the  memoryless  channel  2^.,  depends  only  on  the 


state  X, . ,  and: 
J\ 


=  t  ?  kkj 


The  Viterbi  algorithm  becomes  a  solution  to  the  following 
problem.  Given  a  sequence  of  N  observations  of  a 

discrete-time,  finite  state  Markov  process  in  memoryless 
(white)  noise,  find  the  state  sequence  ^  for  which  the 

"a  posteriori"  probability  p  |  {xk}  1  I  {  Zk}  *lj  is  maximum.  P 

is  merely  the  MAP  decision  rule.  This  rule  is  known  to 
minimize  the  error  probability  in  detecting  the  whole 
sequence  and  is,  therefore,  optimum  in  this  sense  (kef  2). 


is  maximum.  Phis 


I 


The  problem  of  maximizing  P  {KKIkUlj- 
the  sequence  for  which: 

{K}i' 


is  equivalent 


to  finding  the  sequence  for  which: 


is  maximum.  This,  in  turn,  is  equivalent  to  minimizing: 


-ln  P{W‘  {zk}i_ 


Fince  equation  (44)  is  a  monotonic  function  and  to  every 
possible  state  sec^uence  M  ^  there  corresponds  a  unique 
path  r  through  the  trellis,  there  is  a  one-to-one 

l*  \ 

correspondence  between  paths  and  sequences. 

From  Bayes  Rule,  equation  (43)  becomes: 

By  invoking  the  Markov  and  memoryless  properties,  equation 
(45)  becomes: 


If  KViK]  f  p(silVi-  X:1 


Scruation  (44)  is  therefore: 


I  {-ln  p<q+ilxj>  - ln  1 

j=l 

Hence,  each  branch  metric  is  assigned  the  length: 

7<V=  *l"  *  ln  *’lzjlxj}  I 

and  the  total  path  length  corresponding  to  the  sequence 

[sji’ ls:  r  1  N 


(47) 
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The  relation  of  equation  (49)  points  out  that  1  may  be 
computed  recursively.  Given  the  branch  length  of  equation 
(36),  the  length  of  path  K,  at  time  j  is: 

rK  (j)  =rK  ( 3-1)  +  7j(m,  1)  (50) 

The  expressions  in  equations  (46)  and  (47)  completely 
define  the  branch  metrics.  The  left  hand  term  represents 
the  transition  probabilities  of  the  Markov  signal  process. 

The  importance  of  specifying  the  process  transition  proba¬ 
bilities  is  now  evident.  To  compute  the  MAP  estimate,  the 
extent  of  prior  knowledge  required  concerning  the  signal 
process  is  simply  the  transition  probability  values  expressed 
in  the  P  matrix. 

The  right  hand  term  of  equations  (46)  and  (48)  is 
derived  from  the  statistics  of  the  channel.  The  P  {  :  I  .} 
depends  upon  the  received  data.  For  a  Guassian  channel, 

-In  F  is  proportional  to  (7^-Xj)^.  Using  the  vector 

representation  presented  earlier,  -In  P  {zkI*k}  is  proportional 


-K  "  -j 


=  1,2 . M 


where: 


ihM  xi 


(See  Appendix  A  for  a  similar  discussion,  using  a  Poisson 
channel).  Equation  (51)  represents  a  comparison  of  the 


received  vector  with  each  of  the  possible  signal  vectors. 

Tlie  branch  metric  at  time  j  becomes: 

T'fm.l)  =  -in  pfe^ilx^Mj+IZj-xJ2  (53) 

A 

Let  the  estimate  at  time  j  be  represented  by  X(j)  in 
order  to  examine  the  recursive  nature  of  the  trellis  path 
length  computation.  The  sequence  {*k}  ^  which  minimizes  I"V 

A  A 

while  passing  through  X(j-l)  on  its  way  to  X(j)  must  do  so 
by  following  sequence  which  minimizes  rK(j-2).  If 

it  did  not,  a  better  sequence  (U  could  be  chosen. 

To  extend  the  MAP  estimate  to  time  j+1,  the  estimator 
must  take  the  new  measurement  Z(j+1)  and,  for  each  amplitude 

state  X(j+l)=£M,  M=  1,2, . M,  calculate  the  I^(j+1)  for 

each  sequence  ^  plus  X(j+1)=^.  For  each  value  of  M,  the 
minimum  path  length,  17,  (j+1)  is  selected  and  the  value  of 
X(j  +  1)  =  ^  is  concatenated  with  the  sequence  which  ends 

in  X(j)=^»  The  sequence  ty  has  then  been  determined. 
At  the  end  of  the  calculation,  the  observation  Z( j+1)  is  no 
longer  required  and,  therefore,  discarded.  There  will  be  M 
amplitude  sequences  stored,  one  ending  in  each  of  the  M 
possible  discrete  amplitude  states.  The  M  sequences  may  be 
extended  another  step  in  time  by  taking  the  measurement, 

Z(  j-f  2 )  ,  and  repeating  the  calculations.  Therefore,  at  time 
jT  (or  simply  j),  it  is  only  necessary  to  store  these  M 


(\}j-  -i. 


.Mj  the  M  values  of  .L ( j )  corresponding  to 
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the  M  sequences:  the  current  time  counter  j:  and  the  transx 
tion  probability  values  ( ^ef  14). 


<rr 


sequences  from  the  previous  time  (j-1)  which  are  not  con- 
catonated  with  state  value  to  form  a  current  survivor 
sequence*  These  unused  sequences  need  not  be  retained. 

(2)  Decision  Depth.  The  Viterbi  algorithm  used  for 
other  than  the  usual  convolutional  coding  application 
becomes  a  problem  of  dynamic  program.  In  particular,  the 
algorithm  is  a  backward  dynamic  programming  method.  The 
term  backward  applies  to  the  manner  in  which  estimations 
are  arrived  at. 

The  state  values  stored  in  the  M  sequences  tend  to 

converge  to  a  single  state  if  the  sequences  are  inspected 

long  enough  in  time.  Because  of  this  convergence,  at  time 

j,  it  is  possible  to  determine  the  MAP  estimate  of  the 

A 

amplitude  sequence  X(j-JQ),  by  selecting  the  sequence 


^  with  the  smallest 


PI  and  outputting  the  X( j-J  )  value 
l'  o 

from  that  sequence.  If  all  the  M  sequences  have  not  con- 

t  A 

verged  to  a  single  state  SM=X(j-J0),  then  JQ  may  be  made 

A 

larger.  Making  JQ  larger  only  guarantees  that  X(j-JQ)  is 

A 

the  MAP  estimate  of  the  true  sequence  value,  not  that  X(j-JQ) 


is  the  closest  neighbor  to  X(j-JQ). 

The  number  JQ  is  the  fixed  lag  of  the  system  and  is 
referred  to  as  the  decision  depth.  Simply  stated,  the 
decision  depth  is  the  time  lag  before  an  estimate  is  output. 
Because  the  estimate  is  made  back  in  time  from  the  current 
observation  as  determined  by  the  decision  depth,  the  term 
backward  dynamic  programming  applies. 
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The  complexity  of  the  estimator  may  be  seen  from  the 

algorithm  statement.  Tbe  majority  of  computing  time  is 

spent  in  calculation  of  the  values  of  T^j).  These  values 

must  be  calculated  M  times  for  each  of  the  M  possible  states, 

at  each  time  jT  j=l,2, . N.  The  complexity  in  terms  of 

2 

computation  time  is  proportional  to  NM  .  As  previously 

stated,  at  time  j,  the  amplitude  may  take  on  one  of  M  values. 

N 

A  sequence  composed  of  N  values  leads  to  M  possible 

sequences  to  search  through  in  order  to  find  the  one  that 

ri  t  h 

(the  K  path)  equation  (49).  As  M  and  N 

become  large,  brute  force,  global  searches  become  impractical 

2 

The  recursive  nature  of  equation  (49)  leads  to  the  NM  term 

stated  above.  Additionally,  the  estimator  outputs  a  sequence 

value  with  a  fixed  lag  in  time,  as  opposed  to  a  global  search 

method  which  must  store  an  entire  observation  sequence  and 

then  determine  the  MAP  estimate  for  the  given  observation 

sequence.  For  a  finite  time  lag: 

J  ««  N  (55) 

o 

the  storage  requirements  are  also  greatly  reduced. 

A  receiver  structure  and  signal  model  have  been  pre¬ 
sented  to  describe  a  system  involving  a  slowly  varying 
message  signal  that  has  been  pulse  position  modulated.  The 
amplitude  of  the  message  may  be  represented  as  a  sequence 
of  quantized  amplitude  (pulse  position)  states.  Using 
backward  dynamic  programming,  it  is  possible  to  compute  a 


A  Monte  Carlo  simulation  of  the  backward  dynamic  pro¬ 
gramming  algorithm  amplitude  sequence  estimator  is  useful 
to  obtain  performance  data  for  an  entire  range  of  input  data 
and  estimator  parameters.  This  chapter  presents  the  simula¬ 
tion  phase  of  this  study.  Ibis  chapter  is  organized  into 
four  sections:  simulation  setup  (software  considerations): 
a  discussion  of  the  assumed  set  of  message  signals:  param¬ 
eter  variation:  and  simulation  results. 

SIMULATION  SETUP: 

The  simulation  program  was  written  in  FORTRAN  V  and  run 
on  the  Data  General  Eclipse/250  system  available  for  use 
in  the  Digital  Signal  Processing  Laboratory  at  the  Air  Force 
Institute  of  Technology.  FORTRAN  v  is  a  Data  General  version 
of  FORTRAN.  This  version  provides  a  great  improvement  in 
execution  time  over  FORTRAN  IV  when  used  on  the  Eclipse. 

(1)  Software.  Ihe  simulation  program  is  divided  into 
four  main  sections.  Once  the  simulation  parameters  have 
been  input,  the  program  first  computes  the  transition 
probability  matrix.  Next,  the  quantized  version  of  the 
message  is  represented  as  a  sequence  of  signal  vectors  as 
in  equations  (6),  (7),  and  (8).  Next,  a  noise  vector  is 
generated,  and  then  added  (OR-ed  with)  to  the  signal  vector 
to  produce  the  observation  vector.  Tbe  true  pulse  position/ 


amplitude  sequence  is  represented  as  a  sequence  of  N  integers 
which  correspond  to  one  of  M  possible  pulse  positions  for 
each  of  N  samples.  The  pulse  position  sequence  is  then  esti¬ 
mated  over  an  observation  period  consisting  of  the  N  samples. 
The  error  and  mean-square  error  are  calculated  for  each 
sample.  The  estimation  is  repeated  for  many  variations  of 
a  single  message  in  order  to  calculate  ensemble  averages  of 
error  and  mean-square  error  at  each  time  interval  (sample). 

(2)  Signal  Set.  A  variety  of  message  signals  were 
constructed  and  used  to  test  the  estimator.  Each  message  is 
derived  from: 

Mi(KT)  =  f(rKT)  (56) 

where: 

r  =  e“u  u  6  (0,  1)  (57) 

The  term  r,  represents  the  "rate"  of  the  signal  r£  (.368,  1). 
Using  the  exponential  relationship  precludes  the  possibility 
of  the  message  having  a  rate  close  to,  or  exactly  zero.  The 
term  KT  represents  the  sample  time. 

A  collection  of  ten  signals  make  up  the  signal  set. 

These  signals  appear  in  Appendix  B.  Each  signal  has  a 
magnitude  less  than  or  equal  to  one  and  this  range  has  been 
quantized  into  M=32  amplitude  states.  The  shape  of  each 
signal  is  determined  by  the  rate  parameter,  r.  By  virtue 
of  the  generation  method,  the  rate  parameter  also  determines 
the  starting  state.  The  signals  are  shown  for  extreme  values 


rr 


of  r.  Each  pair  of  figures  shows  graphically  the  affect 
the  rate  parameter  has  on  the  overall  shape  of  the  signal 
as  well  as  its  affect  on  the  starting  state.  Ihe  random 
starting  state  reflects  more  accurately,  a  realistic  signal 
and  will  demonstrate  estimator  effectiveness  for  an  unknown 

starting  state  within  the  trellis.  Each  signal  has  a  peak 
amplitude  of  1.0. 

Hie  relationship  used  to  generate  each  signal  is  also 
provided  in  Appendix  B.  It  is  worthy  of  note  that  only 
signal  #3,  the  sinewave  has  a  random  shift.  Hiis  random 
shift  provides  the  random  starting  state  desired  for  each 
simulation.  The  assumed  starting  state  used  for  simulations 
involving  signal  #3  was  ?1=16* 

Lastly,  for  signals  #6-#10,  a  fixed  time  delay  of  five 
seconds  (one  half  the  observation  period)  was  used.  The 
maximum  occurs  at  this  time  for  each  signal  (#6-#10)  and, 
therefore,  the  ensemble  average  state  error  and  ensemble 
average  mean-sguare  error  graphs  will  reflect  the  estimator 
performance  during  this  known  transition  period.  The  ability 
of  the  estimator  to  adjust  to  a  transition  (change  of  slope) 
is  an  important  aspect  of  the  estimator's  performance  and, 
therefore,  only  a  fixed  time  delay  was  used  so  that  the  error 
performance  was  easily  distinguishable  from  the  startup 
(initial  transient)  error. 

Hie  estimate,  as  derived  by  dynamic  programming  (VA), 
is  independent  of  the  assumed  starting  state  if  the 
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observation  period  is  long  compared  to  the  number  of  possible 
states  (n»>+1)  (Ref  2).  The  algorithm  must  start  without 
exact  knowledge  of  the  starting  state.  The  algorithm  is, 
therefore,  initialized  with  a  branch  length  I"* (0)=0  and  an 
assumed  starting  state.  After  an  initial  transient,  the 
startup  error,  there  is  a  high  probability  that  all  survivors 
will  merge  with  the  correct  path  (Ref  2).  The  algorithm  is 
said  to  be  self-synchronizing. 

The  initial  branch  length,  as  well  as  the  chosen  initial 
state,  may  reflect  any  a  prior  knowledge  of  the  message. 

The  initial  state  (£^=5)  chosen  for  signals  #6-#10  and 
(£^=16)  for  signal  #3  reflects  an  appropriate  estimate  of 
the  initial  state  based  on  known  signal  performance.  The 
<pr  state  (£^=5)  reflects  some  a  priori  knowledge  the  signal 

may  start  close  to,  but  not  exactly  zero  amplitude.  A 
similar  argument  holds  for  signal  #3. 

PARAMETER  VARIATION: 

Five  parameters  must  be  determined  prior  to  each 

simulation;  four  (  \  ,  M,  T) ,  pertain  to  the  signal  model 

and  one,  (JQ)  to  the  algorithm.  The  first  four  are  used  in 

calculating  the  transition  probabilities  (priors)  used  by 

the  algorithm  and  must  be  considered  in  estimator  performance. 

The  fifth  pertains  to  the  memory  established  by  the  priors 

within  the  trellis  and  its  branches.  The  term,  J  ,  determines 

o 

the  manner  in  which  the  algorithm  uses  this  memory. 
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A  discussion  of  the  relationship  between  these  param¬ 
eters  is  presented  in  this  section.  This  discussion  pro¬ 
vides  the  basis  for  the  variations  made  in  the  parameters 
used  for  each  simulation. 

(1)  Transition  Probability  Values.  The  transition 
probability  matrix  for  M=32  state  process  becomes  a  32  x  32 
square  matrix.  The  stochastic  matrix  is  generated  using 
equations  (31)  and  (33).  For  signals  #3  and  #6-#10,  the 
rate  parameters  of  equation  (33)  are: 


X=/i=r  <58> 

For  signals  #1  and  #5,  the  rate  parameters  are: 

X  *  r  (59) 

f±  =  .0001  (\) 

and  for  #2  and  #4: 

fl  =  r  (60) 

X  =  .0001  (/jO 

These  parameters  were  based  on  general  signal  behavior  and 
an  attempt  to  describe  the  relative  rate  of  change  of  the 
signal  in  terms  of  the  queing  model  parameters. 

Signals  #1  and  #5  may  be  described  by  a  limiting  case 
birth-death  process.  This  limiting  case  is  a  finite  state 
pure  birth  process.  The  rate  parameters  for  a  pure  birth 
process  involve  only  the  arrival  rate  X  ( M=  0).  The  system 
expands  from  some  population  size  up  to  its  maximum  (the 
maximum  being  an  absorbing  state).  Hie  value  for  the 


arrival  parameter  expressed  in  equation  (59)  is  valid  for 
the  range  of  values  of  \  used  and  allows  the  natural  log 
(In)  of  the  elements  of  the  transition  probability  matrix 
equation  (48)  to  be  finite. 

Similarly,  signals  #2  and  #4  may  be  described  by  a 
pure  death  process.  The  only  rate  parameter  needed  is  the 
serving  rate,  /2.  This  type  of  system  starts  at  some  popula¬ 
tion  level  and  will  decrease  in  size  with  each  sample  time. 

For  this  model,  the  relation  of  equation  (60)  is  valid  for 
the  range  placed  on  the  values  of  r. 

The  remaining  signals  are  more  adequately  described 
by  equation  (58),  Neither  fl  nor  X  are  assumed  to  be  zero. 
Additionally,  the  symetric  nature  of  these  remaining  signals 
lead  to  the  description  of  equation  (58)  with  respect  to  the 
finite  population  queing  model. 

The  parameter  T,  in  equation  (33)  is  the  sample  period. 
Expressions  (33)  and  (34)  imply  that  the  number  of  states  M 
and  the  rate  parameters  X  and  fl  ,  will  determine  the  maxi¬ 
mum  value  for  T.  Any  relationship  between  X.  K  M,  and  T 
must  provide  for  two  limiting  conditions.  First,  the  require¬ 
ments  of  equations  (27)  and  (28)  must  be  satisfied.  Secondly, 
the  relationship  must  be  such  that  the  sample  rate,  fs=l/T, 
is  fast  enough  to  provide  some  degree  of  memory  for  the 
algorithm  in  addition  to  limiting  the  change  in  value  of  the 
sampled  signal  to  +1  amplitude  states/pulse  positions  from 
sample  to  sample. 
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The  sample  rate  provides  the  "memory"  for  the  MAP 
estimator.  The  term  memory  is  somewhat  nebulous:  however, 
it  describes  appropriately,  the  amount  of  information  pro¬ 
vided  by  the  transition  probability  matrix  of  equation  (31). 
An  analogy  may  be  derived  from  a  discussion  of  bandwidth  and 
Nyquist  rate  sampling. 

A  Nyquist  sampled  (band  limited)  signal,  may  be  recon¬ 
structed  by  a  low  pass  filter,  if  the  cutoff  frequency  of 
the  low  pass  filter  is  equal  to  the  maximum  frequency  of 
the  signal,  f„.  A  sample  rate  of  less  than  2f  or  a  filter 
cutoff  frequency  not  equal  to  fg  will  produce  aliasing. 

The  concept  of  signal  reproduction  via  Nyquist  sampling 
is  not  a  concern,  however,  a  relationship  to  indicate  a 
lower  bound  on  the  sample  rate  that  guarantees  equations 
(27)  and  (28)  and  provides  enough  memory,  is  desired.  The 
relationship  hypothesized,  in  terms  of  the  queing  model 
parameter  is  given  as: 

K<Xmax«>  =  fs  K  =  1  (61) 

Clearly  equation  (61)  provides  values  of  fg=l/T  that  will 
satisfy  equations  (27)  and  (28)  for  KS1.  The  question  to  be 
addressed  is  will  equation  (61)  provide  the  needed  memory, 
and  over  what  ranges  of  receiver  performance?  It  will  be 
shown  that  equation  (61)  is  adequate  for  specific  receiver 
characteristics.  Specifically,  as  the  number  of  anamolous 
pulses,  A,  increases,  the  minimum  sample  rate  of  equation 
(61)  is  not  adequate  for  all  signal  rates.  A  faster  sample 


rate  is  required  to  increase  the  amount  of  memory.  The 
value  of  K  must  be  increased  as  the  memory  requirement 
increases. 

The  sample  rate  chosen  initially  was  (K=1.5625): 

fs  =  50  samples /sec  (S/S)  (62) 

Based  on  equation  (61),  this  rate  is  adequate  for: 

\  2  .78125  (63) 

for  some  value  of  A.  The  sample  rate  of  equation  (62)  was 
shown  to  be  adequate  for  all  \€  (.36,  1.0)  if  the  number 
of  anamolous  pulses  was  less  than  12.  The  inadequacy  of 
equation  (62)  showed  up  first  for  signals  with  \  .78125. 

The  sample  rate  was  then  increased  to  64  samples  per  second. 

As  the  number  of  anamolous  pulses  is  increased  to  A=22, 
the  sample  rate  of  64  s/S  (Jq=5)  is  adequate  to  provide  a 
reasonable  reconstruction  for  signals  with  X  —  .4.  That  is, 

the  value  of  K  must  be  increased  to  5,  and  from  equation  (61): 

fs  2  160  (64) 

There  is  obviously  some  limit  to  this  relationship.  As  A 
increases,  the  algorithm  must  rely  more  on  the  priors  to  dis¬ 
tinguish  the  shortest  path  from  the  entire  set  of  paths.  Each 
path  length  will  vary  by  the  contribution  of  the  transition 
probability  values  (priors).  Once  A=31,  the  priors  will 
not  provide  the  distinction  needed,  no  matter  what  the  sample 

rate.  Clearly,  there  must  exist  an  upper  limit  on  the  sample 

rate.  This  upper  limit  will  provide  the  memory  for  some 
upper  limit  on  the  number  of  anamolies,  A.  Determination  of 


these  upper  bounds  is  beyond  the  scope  of  this  study  as  is  any 
expression  relating  the  two  values.  An  attempt  is  made,  how¬ 
ever,  to  find  the  value  of  A,  at  which  a  reliable  reconstruction 
may  no  longer  be  achieved  for  a  given  ensemble  of  message 
signals  and  a  given  set  of  model  and  estimator  parameters. 

In  the  previous  chapter,  the  idea  of  a  decision  depth 
was  introduced.  The  decision  depth  and  the  assumed  initial 
state  are  two  algorithm  parameters  that  may  be  adjusted 
independent  of  all  other  parameters. 

In  the  context  of  a  convolutional  encoder/decoder ,  the 
memory,  as  provided  by  the  encoder,  is  represented  in  the 
form  of  a  constraint  length  (Ref  2).  The  decision  depth  is 
correspondingly,  set  at  three  to  five  times  this  constraint 
length.  FOr  this  study,  no  such  constraint  length  exists, 
as  the  memory  is  supplied  by  the  sample  rate.  Instead,  the 
notion  of  trellis  maturation  is  used  to  describe  a  minimum 
as  well  as  a  sufficient  decision  depth. 

Appendix  D  depicts  a  trellis  diagram  for  a  seven  state 
process.  The  state  transitions  depicted  by  the  branches 
follow  the  assumptions  pertaining  to  the  signal  model.  It 
is  evident  from  Figure  174  that  a  "legal  path"  connecting 
all  possible  states  does  not  exist  until  time  (K+6)T.  The 
trellis  shows  that  the  time  required  to  provide  a  minimum 
of  one  "legal  path"  (see  Appendix  D)  connecting  all  legal 
states  is  dependent  upon  the  assumed  initial  starting  state. 

This  time  will  be  referred  to  as  the  maturation  time  and 


will  provide  what  will  be  hypothesized  as  the  minimum  deci¬ 


sion  depth.  The  minimum  decision  depth  becomes: 


and: 


J  =  M  -  £ 
o  Si 


Jo  =  £i 


2?is 


1?  ™  ” 


(65) 


The  range  on  JQ  becomes: 

16<Jq<31  ^  £.  (67) 

where  again  £  is  the  assumed  starting  state.  It  will  be 
shown  that  the  performance  of  the  algorithm  improves  as  the 
value  of  JQ  is  increased  to  the  level  specified  by  equations 
(65)  and  (66)  for  given  values  of  A.  For  a  given  value  of  A, 
it  will  be  demonstrated  that  making  JQ  arbitrarily  large 
does  nothing  to  improve  performance.  Specifically  as  A 
increases,  increasing  the  decision  depth  fails  to  gain  an 
improvement  in  algorithm  performance. 

(2)  Sensitivity.  In  view  of  the  previous  discussions 
concerning  model  qualification,  signal  rate,  and  the  manner 
in  which  they  contribute  to  the  prior  knowledge  used  by  the 
estimator,  two  facets  of  sensitivity  will  be  addressed. 


First,  the  sensitivity  of  the  algorithm  to  the  model 
used  to  compute  the  priors  will  be  examined.  In  particular, 
what  will  happen  if  a  signal  model  describing  signals  #1  and 
#5  is  used  to  form  the  priors  when  the  signal  to  be  estimated 
is  one  of  the  other  eight?  Similarly,  how  will  the  perform¬ 
ance  of  the  estimator  be  affected  if  a  pure  death  process 


is  used  to  form  the  priors  when  the  other  types  of  signals 
are  to  be  estimated?  The  variance  in  performance  is  referred 
to  as  model  sensitivity. 

Secondly,  the  sensitivity  of  the  algorithm  when  a 
random  rate  parameter  is  used  to  derive  the  priors,  will  be 
demonstrated.  Specifically,  how  will  performance  vary  when 
the  correct  model  is  used;  however,  the  rate  parameter  used 
to  generate  the  signal  is  not  equal  to  the  rate  parameter 
used  to  generate  the  transition  probability  matrix.  Sensi¬ 
tivity  of  this  type  is  referred  to  as  rate  sensitivity. 

Rate  sensitivity  is  related  to  the  discussions  on  the  sensi¬ 
tivity  of  the  Viterbi  algorithm  to  source  statistics  (Ref 
16)  and,  therefore,  only  a  slight  change  in  performance  is 
expected. 

The  Monte  Carlo  simulation  study  was  used  to  provide 
measures  describing  the  average  performance  of  the  estimator. 
Additionally,  the  performance  of  the  estimator  may  be 
examined  for  specific  signals  within  the  ensemble.  Computer 
resource  availability  precludes  an  exhaustive  study  of  param¬ 
eter  variation.  The  sample  rate  and  decision  depth  must  be 
considered  the  most  critical  elements  toward  providing  a 
reliable  MAP  estimate.  Therefore,  the  simulation  results 
to  follow  will  demonstrate  an  acceptable  level  of  performance 
for  specific  values  of  sample  rate  and  decision  depth. 


SIMULATION  RESULTS: 

Hie  results  of  the  estimator  simulations  are  presented 
in  this  section  and  shown  in  the  figures  that  follow.  The 
parameter  values  and  conditions  are  shown  in  the  figures. 

The  notion  of  an  expanded  trellis  used  for  the  computer 
simulations  is  discussed  in  Appendix  D. 

(1)  Confidence  of  Sample  Statistics.  The  data  pre¬ 
sented  in  the  following  figures  are  a  result  of  taking  en¬ 
semble  averages  of  the  mean-square  error,  as  well  as  ensembl 
averages  of  the  state  error,  over  25  Monte  Carlo  runs.  This 
value  was  selected  by  observing  how  the  average  of  the  en¬ 
semble  mean-square  error,  ^MSE^1  changes  with  increased 
number  of  runs,  shown  in  Figure  17.  As  the  number  of  runs 
increases,  the  ensemble  average  mean-square  error  tends  to 
settle  down  to  a  specific  value.  The  number  25  was  selected 
to  provide  meaningful  results  at  a  reasonable  expenditure  of 
computer  time.  This  number  was  reduced  to  20  without  any 
loss  in  accuracy  when  the  sample  rate  was  increased  from  50 
samples /second  to  64  samples /second.  Similar  conclusions 
were  drawn  by  observing  the  ensemble  average  of  the  state 
errors  as  the  number  of  runs  is  increased. 

The  performance  of  the  estimator  is  related  to  the 
ensemble  average  of  the  rate  parameters  used  to  generate 
the  signals.  As  expected,  the  estimator's  average  perform¬ 
ance  is  better  when  the  average  signal  rate  is  low  and  the 
ensemble  average  performance  worsens  as  the  average  signal 
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FIGURE  17.  Number  of  Runs 


rate  increases.  Since  the  rate  parameters  are  derived  from 
a  uniform,  (0,  1),  distribution  of  random  numbers  ^  i  the 
relation  of  equation  (57),  an  average  rate  parameter  of  .6 
corresponds  to  the  expected  value  of  an  ensemble  of  rate 
parameter  derived  from  a  uniform  distribution  of  random 
variates.  Therefore,  a  range  of  values  for  the  average 
signal  rate  of  (.6  -  .7)  was  used  when  comparing  ensemble 
average  mean-square  error,  ensemble  average  state  error 
and  average  probability  of  error. 

(2)  Performance  Measures.  Estimator  performance  is 
expressed  in  four  ways.  1116  first  is  actual  comparison 
between  the  original  state  sequence  and  estimated  state 
sequence.  This  comparison  will  demonstrate  the  performance 
of  the  estimator  for  a  specific  signal  with  respect  to  pro¬ 
viding  an  accurate  reconstruction.  The  second  and  third 
method  of  expressing  performance  is  from  the  ensemble  average 
mean-square  error  and  the  ensemble  average  state  error.  The 
average  state  error  is  an  ensemble  average  of  the  difference 
between  the  estimated  state  at  time/sample  K  and  the  actual 
state  at  that  time.  These  methods  depict  the  estimator's 
performance  over  an  entire  ensemble  of  signals  within  a 
given  set.  The  fifth  method  will  be  defined  as  the  average 
probability  of  error,  For  this  study,  the  average 

probability  of  error  is  simply  defined  as  the  ratio  of  the 
average  number  of  error  estimates  to  the  total  number  of 


estimates  made.  This  measure  tends  to  be  sensitive  and  mis¬ 
leading.  Simply  put,  this  measure  tells  how  often  the 
estimator  was  in  error  on  an  absolute  scale  (Ref  11).  The 
<PE>  is  sensitive  to  all  parameter  changes,  particularly 
the  average  rate  used  to  generate  the  ensemble  of  signals. 

A  lower  average  rate  parameter,  ^RATs}>  produces  a  lower 
^PE^  The  measure  is  misleading  in  that  for  an  estimate 
of  640  samples  (as  will  be  shown),  there  is  a  point  after 
which  trying  to  improve  this  measure  results  in  no  noticeable 
change  in  the  estimated  sequence  (assuming  an  accurate 
reconstruction  has  been  achieved).  For  example,  a  PE 
equal  to  .20  appeared  to  indicate  the  estimator  was  able 
to  reconstruct  each  signal  of  the  ensemble  accurately.  If 
parameters  were  changed  to  improve  this  figure,  .2,  the 
estimator  output  will  improve  on  an  estimate-by-estimate 
basis,  however,  graphic  comparison  between  the  original 
sequence  for  a  given  signal  reveals  no  appreciable  enhance¬ 
ment. 

A  different  measure  has  beer,  defined  to  replace  the 
conventional  signal-to-noise  ratio  (SNR)  reference.  The 
new  reference  is  the  average  threshold  crossing  ratio, 

^ZCR^  #  The  SNR  term  has  little  meaning  based  on  the 
assumptions  and  characteristics  presented  earlier.  The 
<ZCF^  *  however,  is  a  useful  reference  for  quantifying 
estimator  performance.  This  ratio  is  defined  as  the 
average  total  number  of  pulses  detected  to  the  number  of 


signal  pulses  per  frame.  Since  the  number  of  signal  pulses 
is  always  one,  this  figure  expresses  the  degree  to  which 
the  sample  value  (pulse  position)  has  been  masked  or 
degraded  by  anamolous  pulses.  Referring  to  Figure  5,  the 
<ZCR>  provides  the  average  number  of  dots  per  sample  time. 
Performance  comparisons  will  generally  be  made  with  refer¬ 
ence  to  a  ^ZCF^  measure.  The  terms  ^ZCR>  ,  ^PE^, 

<RATE^  appear  on  each  performance  plot  for  reference. 
Additionally,  the  average  difference  between  the  assumed 
starting  state  and  the  actual  starting  state,  <DIFF>  is 
also  provided. 

(3)  Estimator  Performance.  Each  sample  signal  was 
tested  using  the  appropriate  models  (58),  (59),  or  (60). 

Initially,  the  lower  sample  rate  of  fs=50  S/S  was  used  along 
with  a  decision  depth,  Jq=5.  This  sample  rate  and  decision 
depth  proved  adequate  for  relatively  low  ^ZCR^.  Adequate 
refers  to  the  estimator's  ability  to  provide  a  reconstructed 
version  of  the  original  sequence  that  retains  a  recognizable 
shape  and  has  a  minimum  of  jump  discontinuities  (i.e.,  state 
transitions  of  greater  than  +1).  NOTE:  In  this  section, 
signal  #6  is  used  to  present  the  performance  of  the  estimator 
The  other  signals  will  be  introduced  when  the  estimator  per¬ 
formance  differs  significantly  from  that  for  signal  #6. 

NOTE:  The  initial  simulations  were  conducted  using  a  zero- 

mean  Guassian  channel  model.  It  became  apparent  that, 
assuming  a  positive  threshold,  capable  of  detecting  a 
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positive  going  pulse,  the  largest  number  of  threshold  cross¬ 
ings  per  frame,  due  to  noise  approaches  a  limit  of  16  only 
as  the  threshold  gets  close  to  zero.  It  was  realized  that 
in  order  to  produce  a  greater  number  of  anamolous  pulses,  a 
nonzero  mean  channel  model  must  be  considered.  The  Poisson 
channel  model  appeared  most  promising  at  first.  Problems 
arose,  however,  in  the  implementation  of  the  Poisson  model 
and  it  was  abandoned  for  a  nonzero  mean  Gaussian  density  for 
high  count  rates  (Ref  11),  therefore,  no  loss  in  accuracy 
was  anticipated  nor  observed.  In  this  manner  also,  the 
metric  of  equation  (53)  essentially  remains  unchanged.  The 
problems  associated  with  the  Poisson  channel  development  are 
presented  in  Appendix  A. 

The  ensemble  average  error  and  the  ensemble  average 
mean-square  error  are  shown  in  Figures  18-23  for  <CzCR> 
values  up  to  23  (average  A=22).  The  mean-square  error  and 
state  error  graphs  provide  information  regarding  the  algorithm's 
ability  to  track  each  ensemble.  Each  graph  shows  the  catchup 
time  and  associated  error  and  the  transition  time  and  asso¬ 
ciated  error.  The  catchup  time  and  error  is  caused  by  the 
difference  between  the  actual  starting  state  and  the  assumed 
starting  state.  The  transition  time  error  is  caused  by  the 
inability  of  the  algorithm  to  track  the  fastest  changes  in 
the  original  state  sequence  and/or  the  inability  of  the 
algorithm  to  follow  the  transition  of  the  signal  near  the 
five  second  point.  For  purposes  of  brevity,  these  errors 
will  be  referred  to  as  transient  error  and  transition  error. 
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NUM  SIM  25  <ZCR>  6.085 
8IG  NUM  6  < PE >  .09896 

DEPTH  5  <RRTE>  .5910 
LEUELS  32  <DIFF>  9.60 
NUMBER  OF  SRMPLES  500 


6 


FIGURE  18.  Ensemble  Average  MSE  Performance 


SIM  23  <ZCR> 


FIGURE  19.  Ensemble  Average  State  Error  Performance 


FIGURE  20.  Ensemble  Average  MSE  Performance 


<  ZCR  >  16. 
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FIGURE  21.  Ensemble  Average  State  Error  Performance 


FIGURE  22.  Ensemble  Average  MSE  Performance 


FIGURE  23.  Ensemble  Average  State  Error  Performance 


For  low  <ZCR^  as  shown  in  Figures  18  and  19,  only 
the  transient  error  is  evident.  The  ensemble  average  mean- 
square  error  graph  provides  little  information  for  low 
<ZCR^  values.  The  ensemble  average  state  error  graphs, 
however,  show  more  completely  the  trends  in  algorithm  per¬ 
formance.  The  state  error  graphs  reflect  periods  of  rela¬ 
tive  stability  that  exist  generally  between  the  transient 
and  transition  error  times.  As  will  be  seen,  as  the  ^ZCR^ 
value  increases,  the  transient  error  occurs  and  transition 
times  will  lengthen,  thus  reducing  the  time  of  estimator 
stability. 

A  sample  state  estimation  is  given  in  Figures  24-32. 

The  limits  on  performance  may  be  realized  by  comparing  these 
six  figures.  As  can  be  seen,  the  estimator  provides  an 
accurate  reconstruction  of  the  original  state  sequence  for 
low  <ZCR^«  As  the  number  of  threshold  crossings  per  frame 
is  increased,  two  factors  are  evident.  First,  the  transient 
error  increases  because  the  algorithm  takes  longer  to  catch 
up  with  the  original  sequence  as  in  comparing  Figures  24  and 
27.  Second,  the  transition  error  begins  to  appear  for  high 
values  of  the  rate  parameter,  r.  This  error  begins  to 
appear  for  <ZCR>  as  iow  as  eight,  but  does  not  become 
significant  until  the  ^ZCR^  reaches  15.  Figures  29-32 
show  significant  transition  error.  As  the  number  of  thresh¬ 
old  crossings  is  increased,  the  transition  error  occurs  for 
lower  values  of  r  and  the  transition  error  region  widens  for 
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ESTIMRTEO  STATE  SEQUENCE 


*0  .00  2.00  4.00  6.00  8.00  10.80 

TIME  <  SEC  > 


FIGURE  27.  Sample  Estimation  -  Depth=5 
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<»  ORIGINAL  STATE  SEQUENCE 


PARAMETERS : 
SIGNAL  •  6 

RATE  .7949 
<  ZCR>  16  .804 
SAMPLES  588 


8  00  2 .80  4 .00  6 .00 

TIME  <  SEC  > 


8  00 


10  00 


ESTIMATED  STATE  SEQUENCE 


0.88  2.88  4.88  6.88 

TIME  (SEC) 


8  .88 


18  .80 


ORIGINAL  STATE  SEQUENCE 


PARAMETERS : 
SIGNAL  •  6 

RATE  .6470 
<  ZCR  >  23  .076 
SAMPLES  500 


0  .00  2  .00  4  .00  6  00 

TIME  < SEC  > 


8  .00 


10  .00 


ESTIMATED  STATE  SEQUENCE 
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FIGURE  30.  Sample  Estimation  -  Depth® 5 


ORIGINAL  STATE  SEQUENCE 


PARAMETERS : 
SIGNAL  •  6 

RATE  .7971 
< ZCR >  23  .222 
SRHPLES  500 
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FIGURE  31.  Sample  Estimation  -  Depth=5 
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higher  values  of  r.  Figures  27,  28  and  29  show  the  tracking 
problem  for  a  ^ZCR^  of  approximately  16.  As  the  <ZCR^ 
is  increased  further,  the  transient  and  transition  errors 
merge.  Ihe  tracking  problem  is  depicted  in  Figures  30-32  for 
^ZCR  ^  =  23  and  the  associated  average  mean-square  error 

and  average  state  error  in  Figures  22  and  23.  The  effect 
of  increasing  ^ ZCR  >  is  evident  by  comparing  Figures  24- 
32. 

The  estimator  performance  _n  Figures  24-32  may  be 
explained  in  terms  of  the  two  quantities  of  equation  (48)  that 
constitute  the  branch  metrics,  and  the  two  types  of  errors 
described  earlier  (transient  and  transition).  It  was 
explained  earlier  that  the  transient  error  is  caused  by 
the  difference  between  the  assumed  starting  state  and  the 
actual  starting  state.  This  error  becomes  more  significant 
with  increasing  <ZCR^  .  However,  this  error  may  be  reduced 
or  even  eliminated  by  providing  more  accurate  starting  state 
information.  Note  the  lack  of  significant  transient  error 
in  Figures  29  and  31  in  spite  of  the  obvious  problems  the 
algorithm  has  in  tracking  the  sequence.  For  these  sequences, 
the  assumed  starting  state  is  more  accurate. 

Ibe  appearance  of  the  transition  error  may  be  attributed 
to  parameters  of  equation  (48),  the  branch  metric.  For 

low  ^  ZCR ^  values,  the  distance  term  of  equation  (48)  as 

given  by  equation  (51),  provides  the  distinguishing  parameter 
to  each  branch.  That  is,  for  low  <ZCR^  ,  the  algorithm 
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is  able  to  use  the  distance  measure  to  a  greater  extent  in 
prDviding  the  shortest  path  through  the  trellis.  In  this 
manner,  the  algorithm  is  able  to  track  rapid  changes  (within 
the  +1  state  limit)  in  the  signal  sequence,  even  when  the 
P  matrix  indicates  a  low  probability  of  such  an  occurrence. 
How  the  P  matrix  provides  this  indication  is  explained  next. 

As  the  <ZCR>  increases,  the  algorithm  must  rely  on 
the  priors,  the  transition  probability  matrix,  to  provide 
the  distinguishing  parameter  in  identifying  the  shortest 
path.  Recall  that  the  values  of  the  P  matrix  are  not  time 
varying  but  are  dependent  upon  the  current  occupied  state 
(i.e.,  current  population).  As  the  gue  develops  or  the 
population  grows,  the  expression  for  the  birth-death 
coefficients  in  equation  (32)  yields  a  greater  probability 
for  a  minus  one  state  transition  (a  death)  or  no  state 
transition,  than  for  a  plus  one  state  transition  (a  birth). 
When  the  algorithm  relies  more  heavily  on  the  priors  to 
compute  the  shortest  path,  this  path  will  reflect  the  P 
matrix  as  defined  by  the  birth-death  coefficients. 

This  indeed  does  occur  in  Figures  30-32.  The  change¬ 
over  point  in  the  P  matrix  for  when  a  death  is  more  likely 
than  a  birth  corresponds  to  approximately  state  16.  The 
estimator  has  some  difficulty  in  overcoming  this  "inertia" 
of  the  P  matrix,  particularly  in  Figure  32.  In  Figure  31, 
the  estimator  cannot  track  the  sequence  during  the  up-siope 
side,  but  does  relatively  well  tracking  the  same  rate  of 
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change  on  the  down-slope  side.  Ihe  behavior  of  the  signal 
in  Figure  31  for  t  £5.0  "fit^1  the  P  matrix.  ltoat  is,  for 
high  current  state  values,  the  probability  of  a  death  is 
much  greater  than  the  probability  of  a  birth.  Therefore, 
since  the  algorithm  relies  more  on  the  transition  proba¬ 
bilities,  and  since  the  message  behavior  matches  the  P 
matrix,  the  estimated  sequence  appears  accurate. 

In  this  manner,  the  performance  is  somewhat  predictable 
for  high  <ZCR^  values.  For  each  signal  (#3,  6,  7,  8,  9, 
10),  the  region  in  which  the  transition  error  first  occurs 
is  predictable  based  on  a  comparison  between  signal  behavior 
and  the  P  matrix.  For  example,  for  signal  #6,  this  region 
is  on  the  up-slope  side  as  depicted  in  Figure  31.  For 
signal  $7,  this  region  is  on  the  down-slope  side  as  depicted 
in  Figure  103.  This  mismatch  for  signal  #7  is  where  the  P 
matrix  indicates  a  greater  probability  of  a  birth  than  a 
death  within  the  que,  but  the  signal  is  experiencing  its 
greatest  down-slope  rate.  Interestingly,  for  signal  #9, 
there  are  two  mismatch  regions:  one  on  the  up-slope  side 
similar  to  signal  #6,  and  one  on  the  down-slope  side  similar 
to  signal  #7.  Similar  regions  exist  for  signal  #3  and  signal 
#10. 

The  relative  performance  of  the  estimator  may  be  seen 
in  Figure  33  with  respect  to  the  average  probability  of 
error  measure,  ^P3^  .  Figure  33  demonstrates  the  sensi¬ 
tivity  of  this  measure,  particularly  for  < ZCR ^  value  above 
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FIGURE  33.  Performance  Comparison 
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16.  NOTE:  This  was  true  for  all  signals.  At  this  point 
in  the  simulation,  it  became  apparent  that  an  accurate  recon¬ 
struction  of  the  original  state  sequence  could  be  guaranteed 
for  ^PE^  —  .20  over  the  entire  ensemble  of  rate  parameters. 
Marginal  reconstruction  is  possible  for  .20  f  <PE^  —  .28 
and  only  immaginative  reconstruction  is  possible  for^PE^ 
^.28.  This  range  of  values  for  ^PE  ^  will  be  reinforced 
as  the  various  parameters  (T,  JQ)  are  changed. 

The  hypothesis  presented  earlier  calls  for  a  minimum 
decision  depth  based  on  the  assumed  starting  state.  The 
sample  rate  hypothesis  of  equation  (61)  suggests  that  increas¬ 
ing  the  sample  rate  (increasing  K  in  equation  (61))  will 
result  in  better  performance.  Computer  resources  restricts 
the  values  of  K  that  may  be  used.  Therefore,  the  value  of  K 
was  increased  to  2,  providing  a  sample  rate  of  64  S/S.  This 
value  provides  a  hypothesized  minimum  sample  rate  for  all 
rate  parameters  which  will  be  used  for  the  remainder  of  the 
simulation. 

Before  the  new  sample  rate  was  increased,  the  effect 
of  increasing  the  decision  depth  was  examined.  The  decision 
depth  JQ  was  increased  incrementally  from  5  to  65.  The 
effect  on  <PE>  is  seen  in  Figure  38.  Once  again,  the 
range  of  <PE>  that  guaranteed  an  accurate  reconstruction 
for  the  entire  ensemble  was  ^PE^  2  .20.  The  effect  of 
increasing  the  decision  depth  is  to  lower  the  <PE>  .  The 
figure  shows  that  increasing  the  decision  depth  beyond  20 
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reduces  the  <PE  >  only  fractionally.  Recalling  that  the 
sample  rate  provides  the  memory  for  the  algorithm.  Figure  38 
demonstrates  that  no  benefit  is  derived  in  delaying  a  decision 
(output  an  estimate)  longer  than  the  extent  of  the  memory 
supplied  by  the  priors. 

Performance  for  <ZCR^  ^  23  deteriorates  rapidly. 

Figures  34  and  35  demonstrate  the  extent  of  the  degraded 
performance  when  the  ^ZCR^  is  increased  to  26.  Hie 
figures  show  that  the  ^MSE^  tends  to  take  off  for  ^ZCR^ 

23,  but  tends  to  stay  flat  for  <ZCR^  —  23  (Figure  22). 

Hiis  performance  suggests  that  steps  taken  to  improve  per¬ 
formance,  within  the  limits  specified  earlier,  would  have  a 
more  noticeable  effect  for  a  ^ZCR^  —  23.  For  these  reasons, 
the  effect  of  increasing  the  sample  rate  and  decision  depth 
was  observed  for  <ZCR>2£  23,  primarily.  Hiese  results 
are  presented  next  and  a  comparison  is  made  to  the  performance 
under  the  conditions  of  the  lower  sample  rate  and  decision 
depth. 

Hie  performance  of  the  estimator,  under  the  new  condi¬ 
tions  is  shown  in  Figures  36  and  37.  A  comparison  of  Figures 
36  and  37  to  Figures  22  and  23  reveals  that  increasing  the 
sample  rate  alone,  has  a  slight  effect  on  the  <PE>  ,  and 
<  MSE  >  .  In  this  case,  the  higher  sample  rate  has  pro¬ 
vided  more  memory,  however,  the  advantage  of  this  memory  is 
minimized  by  forcing  early  decisions  (Jq=5).  Simulations 
using  longer  decision  depths  were  conducted  to  produce  the 
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FIGURE  34.  Ensemble  Average  MSE  Performance 


FIGURE  35.  Ensemble  Average  State  Error  Performance 


Ensemble  Average  MSE  Performance 


OF  SIMULATIONS 


FIGURE  38.  Versus  Depth,  Vary  <ZCR>  ,  Number  of  Samples 


relationship  in  Figure  38.  This  figure  shows  that  minimal 
gain  in  performance  is  realized  with  a  decision  depth  >54. 

This  value  corresponds  to  twice  the  minimum  decision  depth 
hypothesized  earlier  (i.e. ,  =  27  f°r  ^  =  5).  Figure 

38  graphically  expresses  the  interrelationship  between  the 
sample  rate  and  decision  depth.  This  is  similar  to  the 
relationship  between  decision  depth  and  constraint  length 
when  the  Viterbi  algorithm  is  used  for  convolutional  decoding 
(Ref  2).  A  decision  depth  beyond  three  or  four  constraint 
lengths  produces  negligible  improvement  in  performance 
(three  or  four  constraint  lengths  being  the  extent  of  the 
memory  usable  by  the  algorithm).  A  sufficier-t  decision  depth 
will  be  referred  to  as  twice  the  minimum  decision  depth  for 
the  given  f  =64  s/s. 

O 

The  ensemble  average  mean- square  error  and  ensemble 
average  state  error  for  J  =54  and  f  =64  S/S  are  shown  in 
Figures  39  and  40.  The  net  effect  of  increasing  the  sample 
rate  and  decision  depth  becomes  more  apparent  by  comparing 
Figures  39  and  40  to  Figures  22  and  23.  The  average  proba¬ 
bility  of  error  has  been  reduced  from  ^PE^  =  .5432  to 
<PE>  =  .2397.  The  performance  for  <ZCR>  =  23  has  been 
enhanced  approximately  to  the  level  of  ^PE^  for  <ZCR^  = 

16  (Figures  20  and  21).  Sample  estimations,  showing  the 
improvement  in  performance  are  provided  in  Figures  41,  42, 
and  43.  The  improvement  is  most  noticeable  when  these  figures 
are  compared  to  Figures  30,  31  and  32;  both  sets  are  for 
<ZCR>  =  23. 
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FIGURE  39.  Ensemble  Average  MSE  Performance 


NUM  SIM  20  < ZCR >  23.023 

SIC  NUM  6  <PE>  .23969 
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FIGURE  40.  Ensemble  Average  State  Error  Performance 
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FIGURE  41.  Sample  Estimation  -  Performance  Improvement 
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FIGURE  42.  Sample  Estimation  -  Performance  Improvement 
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FIGURE  43.  Sample  Estimation  -  Performance  Improvement 
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(4)  Model  Sensitivity.  The  assumed  model  is  used  to 
derive  the  priors  for  the  shortest  path  solution.  The  sensi¬ 
tivity  of  the  estimator  to  the  chosen  model  was  investigated 
for  <ZCR^  =  8  and  <ZCR^  =  23.  For  each  test,  a  sample 
rate  of  64  S/S  and  Jq=30  was  used.  To  test  the  sensitivity 
of  the  algorithm,  an  estimate  of  signal  #6  was  attempted 
using  equations  (59)  and  (60)  instead  of  equation  (58).  The 
results  are  shown  in  Figures  44-51.  For  both  cases,  the 
performance  is  worse  for  ^ZCR^  =  23.  It  is  interesting 
to  note  that  for  <ZCR>  =  8.5,  the  algorithm  is  quick  to 
recognize  the  part  of  the  signal  sequence  that  resembles 
the  process  as  described  by  equation  (59)  or  (60).  When 
equation  (60)  is  used,  the  algorithm  catches  up  to  the 
sequence  on  the  downward  slope  c  the  signal  (resembles 
a  pure  death  process)  as  in  Figure  47.  When  equation  (59) 
is  used  (pure  birth  process),  the  algorithm  follows  the 
sequence  until  the  transition  point  and  then  begins  to 
wander  as  in  Figure  45.  Hie  estimator  takes  the  entire 
observation  period  to  catch  up  when  <ZCR>  =  23  and  equa¬ 
tion  (60)  is  used,  as  shown  in  Figure  53.  Similarly,  when 
<ZCR>  =  23  and  equation  (59)  is  used,  the  estimate  is  margi 
nal  on  the  upward  slide  of  sequence  and  the  wandering  on  the 
downward  side  is  more  pronounced,  as  shown  in  Figure  49. 

The  figures  reinforce  the  expected  sensitivity  of  the 
algorithm  to  the  model.  This  model  sensitivity  should  not 
be  confused  with  mere  sensitivity  to  source  statistics  (Ref 
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FIGURE  44.  Model  Sensitivity  -  Pure  Birth  Statistics 
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FIGURE  46.  Model  Sensitivity  -  Pure  Death  Statistics 
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FIGURE  47.  Model  Sensitivity  -  Pure  Death  Statistics 
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FIGURE  48.  Model  Sensitivity  -  Pure  Birth  Statistics 
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FIGURE  49.  Model  Sensitivity  -  Pure  Birth  Statistics 


FIGURE  50.  Model  Sensitivity  -  Pure  Death  Statistics 
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FIGURE  51.  Model  Sensitivity  -  Pure  Death  Statistics 


16).  Sequences  modelled  by  equations  (59)  and  (60)  are  no 
longer  represented  by  a  tri-diagonal  matrix  similar  to  equa¬ 
tion  (31),  although  the  relationship  of  equation  (29)  is 
still  used.  The  possible  transitions  have  been  reduced  in 
terms  of  the  transition  probability  values.  Three  possible 
transitions  still  exist,  however,  only  two  exist  with  any 
finite  probability.  Therefore,  changing  the  model  does  more 
than  change  the  source  statistics.  Ideally,  if  fJi  =  0  in 
equation  (59),  and  \  =  0  in  equation  (60),  the  entire 
trellis  is  modified  as  only  two  transitions  are  possible, 
and  equation  (31)  becomes  a  bi-diagonal  matrix. 

(5)  Rate  Sensitivity.  The  sensitivity  of  the  algorithm 
to  the  rate  parameter  is  similar  to  the  sensitivity  to  source 
statistics  discussed  by  Ref  16.  Using  equation  (58),  a 
different  rate  parameter  was  used  to  generate  the  signal 
sequence  and  the  transition  probability.  The  same  parameters 
were  used  as  for  the  model  sensitivity  tests.  Each  of  the 
two  rates  used  were  generated  randomly  and  independently. 

The  results  are  shown  in  Figures  52-57  for  various  <ZCR^ 
values.  No  degradation  in  performance  is  observed  when 
compared  to  performance  under  the  conditions  of  equal  rate 
parameters.  The  estimator  still  exhibits  marginal  per¬ 
formance  for  <ZCR^  =  23  but  acceptable  performance  when 
the  <ZCR^  2  20  (comparing  performance  when  fs=64  S//s  and 
Jq=30).  Figure  58  shows  a  comparison  of  performance  based  on 
increasing  <ZCR> .  As  expected,  the  algorithm  is  insensitive 
to  the  rate  parameter  used. 
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FIGURE  53.  Ensemble  Average  State  Error  Performance  -  Random  Rate  Parameter 
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FIGURE  54.  Ensemble  Average  MSE  Performance  -  Random  Rate  Parameter 
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FIGURE  56.  Ensemble  Average  MSE  Performance  -  Random  Rate  Parameter 
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FIGURE  57.  Ensemble  Average  State  Error  Performance  -  Random  Rate  Parameter 


PLOT  DATA: 


FIGURE  58.  Rate  Sensitivity  Comparison 


(6)  Signal  Set  Performance.  Estimations  of  the  remain¬ 
ing  signals  (7,  8,  9,  10,  and  3)  were  performed  for  various 
^ZCR^  values.  In  all  cases,  performance  varied  little 
from  that  of  signal  #6.  These  simulations  are  provided  in 
Appendix  C.  In  general,  the  performance  of  the  estimator  for 
each  signal  lagged  that  of  signal  #6.  Significantly,  poor 
performance  was  observed  for  signal  #10.  This  is  based, 

for  the  most  part,  on  its  transition  periods.  Unlike  the  other 
signals  (6,  7,  8,  and  9),  signal  #10  exhibits  a  rapid  transi¬ 
tion  from  upward  to  downward  slope.  Most  of  the  estimator 
error  is  spread  over  this  transition  region.  Additionally, 
adequate  reconstruction  of  the  entire  ensemble  could  not  be 
achieved  for  as  high  a  ^ZCR^  value.  The  sample  estimates 
provided  exhibit  a  cross  section  of  tracking  problems  incurred 
for  each  signal. 

(7)  comments.  The  data  provided  in  this  section 
reinforce  the  modelling  of  an  adequately  sampled  signal  as 
a  discrete  time,  finite  state,  birth-death  process. 

Expressing  the  signal  sequence  as  such  a  first  order  Markov 
process  allows,  the  Viterbi  algorithm  (dynamic  programming) 
to  be  used  to  provide  maximum  a  posteriori  estimate  of  the 
signal.  In  this  sense,  the  estimator  may  be  assumed  optimum 
and  unbiased. 

The  data  presented,  based  on  the  birth-death  process 
model,  indicate  that  relationships  exist  between  model  and 
algorithm  parameters,  similar  to  those  established  for 


convolutional  encoding/decoding  utilization  of  the  Viterbi 
algorithm. 

Hie  results  indicate  an  ability  to  reduce  the  multi¬ 
point  data  with  a  high  degree  of  confidence  in  the  reduced 
data.  The  data  presented  indicate  a  limit  to  the  ability 
of  the  estimator  to  provide  single  point  data  with  a  high 
degree  of  confidence,  based  on  the  assumed  model  and  hypothe 
sized  parameter  relationships.  An  exhaustive  study,  based 
on  parameter  variation,  would  be  expected  to  provide  more 
accurate  parameter  relationships. 

Hie  performance  of  the  estimator  for  the  entire  message 

set  is  summed  up  in  Figure  59.  For  each  estimation,  a  sampl 

rate  of  64  s/s  was  used  and  a  decision  depth,  J  =  (2*J  .  ) 

o  min 

was  used.  Performance  for  the  entire  set  is  consistent  in 
that  the  "break  point"  is  for  a  range  of  <ZCR>  greater 
than  21  and  less  than  or  equal  to  23. 


OF  SIHULRT IONS 


FIGURE  59.  Message  Performance  Comparison 


CONCLUSIONS  AND  RECOMMENDATIONS 


This  report  has  dealt  with  the  problem  of  PPM,  multi¬ 
point  data  reduction  via  amplitude/pulse-position  sequence 
estimation  in  the  presence  of  white  Gaussian  noise.  A 
specific  receiver  structure  and  a  unique  signal  model  based 
on  this  structure,  has  been  presented.  The  performance  of 
a  MAP  estimator,  based  on  a  single  Markov  signal  model,  has 
been  presented  for  a  variety  of  messages  signals.  The  per¬ 
formance  of  the  estimator  suggests  that  the  "bit  lock-out" 
technique  may  be  a  viable  alternative  to  the  frame  lock-out 
technique  for  dealing  with  anamolous  errors  in  PPM.  As  with 
any  investigation  or  study,  many  new  questions  are  asked. 
These  questions  become  the  impetus  for  further  study. 


CONCLUSIONS: 

The  primary  objective  of  this  study  was  to  provide  an 
automated  technique  for  reducing  the  given  multipoint  PPM  data 
to  single  point  data  with  a  high  degree  of  confidence  that 
the  edited  data  accurately  reconstructs  the  original  message 
signal.  The  primary  concern  was  a  reconstruction  that  pre¬ 
served  the  shape  of  the  message  rather  than  provide  a  point- 
to-point  mapping  of  original  to  estimated  messages. 

The  pulse-position  sequence  Viterbi  algorithm  estimator, 
with  32  pulse  position  quantization  levels,  has  been  shown  to 
provide  single  point  data  that  provide  a  reconstructed 
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message  with  variable,  but  predictable,  levels  of  confidence. 
Since  the  probability  of  at  least  one  anamolous  pulse  occur¬ 
ring  per  frame  =  1.0,  the  performance  of  the  estimator  has 
been  expressed  in  terms  of  the  total  number  of  threshold 
crossings  per  frame  (signal  plus  anamolies).  The  primary 
performance  indicator  was  the  average  probability  of  esti¬ 
mator  error,  ,  defined  as  the  number  of  error  estimates 

divided  by  the  total  number  of  estimates. 

It  is  impossible  to  compare  the  bit  lock-out  estimator 
performance  with  other  estimators.  Instead,  a  relative  per¬ 
formance  rating,  with  respect  to  the  objectives  stated  earlier, 
must  be  made.  Ihe  estimator  does  provide  an  accurate  recon¬ 
struction  of  the  original  message,  based  upon  the  assumed 
message  set,  and  the  general  assumptions  made  regarding  the 
behavior  of  the  message.  As  expected,  the  ability  of  the 
estimator  to  provide  a  reconstruction  with  a  high  level  of 
confidence  deteriorates  as  the  number  of  threshold  crossings 
per  frame  increases.  This  was  shown  to  be  true  for  each  of 
the  six  sample  messages. 

A  relationship  between  the  signal  model  parameters  and 
the  Viterbi  algorithm  parameters  heretofore  did  not  exist. 

An  attempt  to  establish  such  a  relationship  was  made  in  this 
study.  In  particular,  a  method  for  determining  a  minimcun 
sampling  rate  in  order  to  provide  sufficient  memory  for 
the  algorithm  to  utilize  was  hypothesized.  Also,  a  minimum 
and  sufficient  decision  depth  was  hypothesized  based  on  the 
trellis  representation  of  the  Markov  process  model. 

118 


A 


Hie  hypothesized  minimum  sample  rate  was  shown  graphic¬ 
ally  to  far  exceed  the  minimum  rate  needed  to  provide  the  +1 
limitation  in  pulse  position  from  sample- to- sample  for  each 
of  the  sample  messages.  The  performance  indicators  imply 
that  the  sample  rate  may  be  determined  by  equation  (61)  where 
K=2  provides  the  minimum  sample  rate  (for  the  range  of  rate 
parameters  used)  that  provides  the  memory  needed  by  the 
algorithm.  The  decision  depth  is  related  to  the  trellis 
defining  each  sequence  estimation.  In  particular,  the  mini¬ 
mum  depth,  as  well  as  a  "sufficient"  depth  was  shown  to  be 
related  to  the  initial  starting  state  used  to  define  the 
trellis.  The  decision  depth  is  related  to  the  maturation 
time  (or  depth)  of  the  trellis  which  is  based  on  the  assumed 
initial  starting  state. 

These  hypothesized  relationships  were  used  to  arrive 
at  the  limiting  point  of  algorithm  performance.  It  was 
shown  that  acceptable  performance  was  possible  when  the 
average  number  of  threshold  crossing,  <C  ZCR  ^  ,  was  less 
than  or  equal  to  23.  Parameter  variation,  both  in  sample 
rate  and  decision  depth,  provided  an  improvement  in  perform¬ 
ance  as  expressed  in  terms  of  ,  for  ZCR  >  2  26. 

The  estimator  was  shown  to  suffer  from  two  types  of 
errors  while  still  providing  a  reasonably  accurate  estimate. 
These  two  being  transient  error  and  transition  error.  When 
the  estimator  fails  to  provide  a  reasonable  facsimile  of  the 


sample  message,  these  errors  merge  and  become  indistinguish¬ 
able.  The  transient  error  and  transition  error  are  insigni¬ 
ficant  for  ^ZCR^  —  16.  However,  for  <^ZCR^  2  16,  these 
errors  become  more  pronounced.  The  effect  of  these  errors 
may  be  reduced  by: 

(1)  Providing  more  accurate  initial  starting  state 
information  to  minimize  the  transient  error. 

(2)  Increasing  the  sample  rate  (i.e. ,  K  value 
in  (61)  and  the  decision  depth. 

It  was  demonstrated  that  increasing  the  decision  depth 
arbitrarily  does  little  to  improve  performance,  for  a  given 
sample  rate. 

RECOMMENDATIONS  FOR  FURTHER  STUDY: 

The  following  areas  are  recommended  for  further  study: 

(1)  The  model  chosen  to  describe  the  signal 
sequence  places  restrictions  on  the  type/behavior  of  the 
message.  It  may  be  possible  to  develop  a  Markov  model  to 
describe  each  sample  message.  In  this  way,  the  observation 
vector  could  be  processed  throi  gh  each  model  in  parallel 
and  the  model  sensitivity  observed  in  this  study  used  to 
provide  the  best  estimate. 

(2)  It  may  be  possible  to  develop  a  Markov  model 
that  does  not  require  a  sample  rate  that  meets  the  adjoining 
state  limitation.  It  is  recommended  that  investigating 


Markov  models  that  allow  pulse  position  changes  of  +2  or 


even  +3  pulse  positions  from  sample-to-sample.  Such  a  model 
may  allow  for  more  complex  (i.e.,  more  rapidly  varying 
signals,  or  those  signals  with  a  modulated  amplitude  like 
that  depicted  in  Figure  4). 

(3)  It  is  recommended  that  a  positive  relationship 
be  developed  to  tie  the  conventional  utilization  of  the 
Viterbi  algorithm  to  other  MAP  estimation  problem  applications 
In  particular,  a  relationship  is  necessary  to  define  a  mini¬ 
mum  sample  rate  to  provide  the  memory  synonymous  with  that 
provided  by  a  convolutional  encoder.  Also,  an  expression 
defining  a  minimum  as  well  as  a  sufficient  decision  depth 
must  be  developed.  This  decision  depth  is  synonymous  with 
the  "3  to  5  constrant  lengths"  used  as  the  sufficient  deci¬ 
sion  depth  measure  for  convolutional  decoding;  hove  ver,  the 
term  constraint  length  has  no  meaning  when  the  Viterbi 
algorithm  is  used  to  estimate  a  general  Markov  process 
(amplitude  or  phase  estimator). 

(4)  In  order  to  refine  the  proposed  model  or 
develop  similar  Markov  models,  a  more  precise  relationship 
must  be  established  between  the  rate  parameter  as  it  applies 
in  determining  the  transition  probabilities  and  as  it  applies 
to  the  message  waveform  itself.  Once  these  relationships  are 
established,  an  upper  bound  on  performance  may  be  established, 
such  as  one  based  on  the  shortest  error  path  within  a  given 
trellis.  Definitive  statements  regarding  model  suitability 


and  algorithm  performance  may  be  maie  once  bounds  on  per¬ 
formance  are  established. 

(5)  It  is  recommended  that  different  channel 
models  be  applied  for  this  problem.  The  Viterbi  algorithm 
assumes  the  channel  is  memoryless  (white  noise).  This  study 
utilized  a  Gaussian  channel  model.  A  nonzero  mean  probability 
density  function,  such  as  Poisson,  with  low  count  rates,  may 
provide  a  more  accurate  description  of  the  channel  effects 

in  producing  numerous  anamolous  pulse  errors.  Once  again, 
all  parameters  (signal  model,  channel  model,  algorithm)  must 
be  tied  together  to  provide  a  measure  on  the  estimator's 
performance. 

(6)  Lastly,  it  is  recommended  to  investigate  the 
effect  of  increasing  the  number  of  bj.t  intervals  per  frame. 

An  arbitrarily  large  number  of  bit  intervals  per  frame  may 
actually  degrade  performance.  Since  each  bit  interval  is  an 
independent  observation  interval,  too  many  intervals  may 
produce  too  many  anamolies  for  the  algorithm  to  reduce  with 
sufficient  accuracy.  An  upper  limit  on  the  number  of 
intervals  per  frame  time  should  be  established. 
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POISSON  CHANNEL 


The  attempt  and  subsequent  abandonment  in  modelling 
the  channel  as  Poisson  is  presented  in  this  appendix.  The 
development  centers  around  arriving  at  the  branch  metric  of 
equation  (53),  using  the  parameters  of  a  Poisson  density. 
The  discussion  begins  with  the  assumption  that  a  low  count 
rate,  Poisson  distribution,  may  be  used  to  model  the 
channel  and  concludes  with  the  reasoning  behind  abandoning 
the  Poisson  model  for  low  count  rates. 

The  Poisson  process  is  a  counting  process  with  a 


density  function: 


|N{T)=n]  = 


T)n  e  “A  T 


In  words,  equation  (68)  defines  the  probability  that  n 
counts  or  occurrences  of  some  event  will  occur  in  time  T. 

The  parameter,  X  is  the  rate  of  the  process  and  has  dimin- 
sions  of  events  per  unit  time.  When  multiplied  by  the 
parameter  T,  the  term  (X  T)  defines  the  mean  or  e{n}  of  the 
process.  Indeed,  the  rate  parameter  may  be  random,  however, 
for  this  study,  X  is  assumed  to  be  deterministic.  Therefore, 


equation  (68)  may  be  rewritten  as: 


,T)n  e-(^T) 


(69) 


What  follows  is  a  discussion  of  the  reasoning  behind  the 
selection  of  the  values  used  for  the  Xt  parameter. 
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A  Poisson  density  for  low  count  rates  ( \  T)  is  not  a 
continuous  function.  An  example  of  such  a  density  function 
is  shown  in  Figure  60.  The  function  exists  only  for  integer 
values  of  n.  As  the  rate  or  mean  of  the  process  increases, 
the  delta  functions  of  Figure  60  become  more  dense,  thus 
approximating  a  continuous  function.  Therefore,  to  assume 
that  the  channel  may  be  modelled  as  Poisson  means  that  the 
occurrence  of  one  "noise  event"  must  not  occur  "too  close," 
in  time,  to  the  next  "noise  event. "  Figure  61  may  help  to 
expand  the  terms,  "noise  event"  and  "too  close."  In  expand- 
hg  these  two  terms,  an  anology  between  the  familiar  RC  low 
pass  filter  network  and  the  denseness  of  the  events  will 
be  drawn  to  add  clarity. 


0.229 


\T=3 


2  3 


5  6 


FIGURE  60.  Sample  Poisson  Density  Function  -  Low  Count  Rate 


FIGURE  61A.  Low  Count  Model 


FIGURE  61b.  High  Count  Model 

Figure  61A  depicts  a  noise  process,  N(t),  and  the 
delta  functions  represent  a  noise  event.  Since  a  Poisson 
process  is  a  counting  process,  a  noise  event  is  not  synony¬ 
mous  with  amplitude  such  as  is  the  case  when  using  a  Gaussian 


channel  model.  Instead,  a  collection  of  events  (a  count) 
over  some  interval  (the  bit  interval  previously  defined) 
will  constitute  an  "amplitude”  value  for  the  noise  pulse. 

The  dotted  (exponential)  line  between  each  event  represents 
the  time  necessary  to  keep  the  events  far  enough  part  in 
time,  in  order  to  keep  the  density  function  discrete.  This 
line,  and  associated  time  is  synonymous  with  the  RC  time 
constant  of  an  RC,  low-pass  filter.  The  shape  of  the  impulse 
response  of  a  RC  low-pass  filter  is  dependent  upon  the 
values  of  R  and  C  (resistance  and  capacitance).  These 
values,  in  turn,  determine  the  bandwidth  of  the  filter. 


FIGURE  62.  RC  Impulse  Response 

Figure  62  depicts  the  impulse  response  of  a  RC  Network.  The 
effect  of  the  impulse  is  said  to  diminish  after  3?.  as 
depicted,  where  7^RC  one  time  constant. 

This  same  criteria  was  used  as  the  basis  for  separation 
between  noise  events.  That  is,  in  order  to  ensure  the  proba¬ 
bility  density  function  is  discrete,  a  "three  time  constant" 
separation  was  established.  The  events  depicted  in  Figure 
61B  do  not  meet  the  criteria  and,  therefore,  would  describe 


a  process  with  events  too  dense  to  be  described  by  a  discrete 
distribution. 

Since  the  values  for  R  and  C  also  determine  the  band¬ 
width  of  the  frequency  response  of  the  RC  network,  the  band¬ 
width  of  the  receiver  may  be  used  to  equate  the  signal  and 
receiver  parameters  to  the  count  rate  of  the  channel  model. 


FIGURE  63.  Inter-occurrence  Time 


Figure  61a  has  been  redrawn  in  Figure  63  defining  the 
inter-occurrence  time,  t^»  between  noise  events.  By  the 
discussion  above,  clearly: 


^3% 


3  (RC) 


The  bandwidth  of  the  receiver  will  be  defined  as: 


5 


(Ref  20) 


(71) 


where  £  stands  for  "greater  than,  but  proportional  to. " 

The  term,  tr  is  the  rise  time  of  the  expected  pulse.  Using 
the  definitions  presented  earlier: 
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T  =  frame  (sample)  time 
=  bit  interval  time 
M  =  #  of  bit  intervals  per  frame 


clearly: 


tb  =  T/M 


and  pulse  rise  time  may  be  defined  as: 


Sr  =  K  fcb 


K  ««  «  1 


The  bandwidth,  B  ,  of  the  RC  network  is  given  by: 

BRC  =  y  =  t/c  (74 

Disregarding  the  constants  of  proportionality  in  equations 
(71),  and  (71)  equated  with  (74)  to  give: 

y  -2tr  554  B  <75 

Since  from  Figure  63: 

ti237  (76 

and  by  substitution: 

2itb  -  brc  -  J  <77 

Since,  t^  is  known,  a  value  for  7  is  available  and,  there¬ 
fore,  a  minimum  value  for  t^  is  also  obtainable. 

However,  the  average  inter-occurrence  time,  ^t^  ^  , 
defines  the  rate  parameter  X  by: 


X  '  <fci>  <7) 

Assuming  only  a  small  difference  in  values  for  t^  for  all 


L3 


! 


1 

.  .* 


1  r*~ 

■ 

•v 

i 


< 


<ti>s^  t.  (79) 

The  average  inter-occurrence  time  will  define  the  rate 
parameter.  Now,  based  on  the  "bandwidth"  of  the  receiver, 
a  value  for  the  Poisson  channel  rate  parameter  is  available 
by  combining  equations  (76),  (77).  and  (78)* 

Since  each  bit  interval  is  an  independent  observation 
interval,  a  range  specifying  the  mean  of  the  counting 
process  was  established  on  a  bit  interval  basis.  That  is: 

5  i  X  tb  S  50  (80) 

This  range  is  arbitrary,  but  such  that  a  Poisson  process  with 
these  mean  values  is  still  considered  discrete.  From  this 
range  and  equations  (77)  and  (78).  a  range  for  receiver 
bandwidth  was  obtained: 

24KHz  2  B  £  240KHZ  (81) 

This  range  was  considered  realistic,  however,  its  accuracy 
was  not  determined  nor  considered. 

It  is  now  convenient  to  introduce  the  problems  in  imple¬ 
mentation  using  the  Poisson  channel  model  for  low  count 
rates. 

First,  the  signal  process  is  not  a  counting  process. 

It,  therefore,  becomes  difficult  to  equate  a  "counting 
threshold"  to  a  receiver  amplitude  threshold  based  on  the 
expected  signal  pulse  amplitude.  A  counting  threshold  was 
needed  to  define  the  occurrence  of  an  anamolous  pulse  within 
a  bit  interval.  It  was  decided  that  a  count  within  a  bit 
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interval  greater  than  some  value  P,  would  constitute  the 
occurrence  of  an  anomoly.  But  this  threshold  has  no  meaning 
with  respect  to  an  amplitude  threshold  that  is  assumed  to 
guarantee  a  probability  of  signal  pulse  detection  equal  to 


If  such  a  correlation  could  be  determined,  the  discrete 
channel  model  of  Figure  9  could  be  used  to  derive  the  path 


metric  term: 


-ln{p(z|Xj)} 


3=1,2, 


(82) 


Since  each  bit  interval  is  independent,  equation  (82 ) 


becomes : 


•t  {ftak}] 

lj=i 


(83) 


Instead  of  the  distance  measure  for  the  Gaussian  case 
(equation  (51)),  this  term  is  specified  by  a  product  of'  the 
bit  crossover  probabilities.  The  distance  measure  for  each 
branch,  in  the  Gaussian  case,  is  obtained  by  comparing  the 
receiver  vector  Z,  with  each  possible  input  vector  S1.  For 
the  Poisson  case,  this  distance  measure  becomes  a  pairwise 
product  of  crossover  probabilities  between  the  observed  Z 
vector  and  each  possible  signal  vector.  An  example  is  most 
beneficial . 

Assuming  a  four  element  vector  (i.e.,  4  bit  intervals 


per  frame),  one  pairwise  product  would  be  that  of  equation 
(85)  for  the  given  received  vector  and  signal  vector: 


||  {p(Zi|Xi)}  =  P(0|0)*P(l|l)*P(l|0)*P(C|0)  (85) 


Unfortunately,  the  crossover  probabilities  are  a  function 
of  the  count  threshold  as  each  crossover  probability  des¬ 
cribes  the  net  affect  of  the  channel  and  receiver. 

Another  problem  with  the  Poisson  channel  had  to  do 
with  sensitivity  to  the  counting  threshold,  P.  For  low 
count  rates,  the  Poisson  distribution  exists  only  for  integer 
values  of  event  occurrences,  n.  Therefore,  the  count  thresh¬ 
old  must  be  some  integer  value.  Additionally,  the  integer 
value  must  be  based  on  the  mean  value  ( X T)  in  equation  (69). 
The  counting  threshold  will  produce  the  ^ZCR^  needed  to 
specify  the  performance  of  the  receiver  (algorithm). 

Numerous  thresholds  for  various  distribution  functions 
defined  by  the  range  of  equation  (80)  were  tested.  Values 
for  P  were  chosen  for  counts  less  than,  equal  to,  and  greater 
than  the  mean  of  the  distribution.  Particularly  for  dis¬ 
tributions  defined  by  tl^e  low  end  of  equation  (80),  there 

was  little  control  over  the  number  of  .anamolies  produced  per 

* 

frame.  A  change  in  the  value  of  P  by  +1  produced  a  large 
change  in  the  average  number  of  anamolies  per  frame.  Not 
only  did  this  phenomenon  make  a  study  of  algorithm  perform¬ 
ance  based  on  changes  in  ^ZCrS^  impossible,  it  also  implied 


that  a  low  count  rate  Poisson  channel  may  not  be  appropriate. 
Hence,  for  the  two  reasons  cited,  a  nonzero  mean  Gaussian 
density  was  chosen  to  model  the  channel.  For  random  variates 
within  +3  O’  of  the  mean,  the  Gaussian  density  function  des¬ 
cribes  accurately  a  high  count  rate  Poisson  distribution. 

The  simulations  are  represented,  however,  under  the  assump¬ 
tions  of  a  Gaussian  channel. 


APPENDIX  B 


SAMPLES  OF  QUANTIZED  VERSIONS  OF  THE  ASSUMED  MESSAGE  SET 


SIGNAL  #  GENERATING  EXPRESSION 


M1(t) 

1.0-EXP^-X  t]  Oft  ^lO.O 

M2(t) 

EXp{-\t}  0<t<10.0 

M3(t) 

.5+{5*SIN(  \t-  X)}  OftflO.O 

M4(t) 

i.o-sxp{X (t-io)j  o<t  510.0 

Mg(t) 

£Xp{X(t-10)}  OS  t  210.0 

M6(t) 

SXp[-(  \(t-5)  )2/lo]  0  St  210.0 

M?(t) 

M1(2t)  02  tS  5.0 

M4C  2 ( t-5)  )  5.0S  t  S10.0 

Mg(  t: ) 

M1(2t)  0  S  t  S5.0 

M2(2(t-5))  5.0S  t  S10.0 

M9(t) 

M5(2t)  0  25  t  S  5.0 

M4(  2 ( t-5 )  )  5.02  tf  10.0 

Mio(t) 

EXP^-X|t-5||  OS  tS  10.0 
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FIGURE  64.  Sample  Message  Sequence 
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FIGURE  65.  Sample  Message  Sequence 


SIGNAL  NUMBER 
RATE  PARAMETER 


FIGURE  68.  Sample  Message  Sequence 


SAMPLE  SIGNAL: 
SIGNAL  NUMBER 
RATE  PARAMETER 
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FIGURE  69.  Sample  Message  Sequence 


SAMPLE 


J 


00  et 


00 it 


00'  tZ  00  91 

Sims  aaniiiduu 


FIGURfi  70.  Sample  Message  Sequence 
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* 
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FIGURi-J  71.  Sample  Message  Sequence 


8ICNRL 


V)  N  N  8 

9  m  ♦ 
9  <4 


(0 

Ui 

_l 

oc  a. 
jk  ui  r 

cut-  <r 

Z  8  IU  0) 

USE 
~  3  C  Ik 

0)  Z  K  O 

c 

a.  (o  a 
-i  tu 

IU  IU  9 
HOE 
C  111  3 

a  -i  z 


99*1  9991 

3ibis  soninduu 


PIG  UR  rl  72.  Sample  Message  Sequence 


FIGURE  73.  Sample  Message  Sequence 


SAMPLE  SIGNAL: 

SIGNAL  NUMBER  6 

RATE  PARAMETER  .3728 


8 


PIGURFJ  74.  Sample  Message 
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FIGURE  7  5.  Sample  Message  Sequence 


SAMPLE  SIGNAL: 

SIGNAL  NUMBER  7 

RATE  PARAMETER  .372? 


FIGURE  76.  Sample  Message  Sequence 


FIG  Ur  rj  77.  Sample  Message  Sequence 
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FIGURE  78.  Sample  Message  Sequence 


SIGNAL : 


CD  ft  N  9 

♦  ft  ♦ 

9  9 

9 


LU  _l  0.  V)  QC 

J  C  -I  Ui 
0.  Z  UJ  Hi  A 

E  U  H  D  r 

C  h  C  ill  3 

0)  «  OC  _l  z 


ee  e> 


00  Z£ 


«  80  91 

3iwis  aonuiduu 


00  e 
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FIGURE  79.  Sample  Message  Sequence 


FIGURE  80.  Sample  Message  Sequence 


FIGURE  81.  Sample  Message  Sequence 
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FIGURE  82.  Sample  Message  Sequence 


SIGNAL 


FIGURE  83.  Sample  Message  Sequence 


APPENDIX  C 
SAMPLE  ESTIMATIONS 


SAMPLE  ESTIMATIONS: 


Sample  estimations  for  signal  numbers  3,  7,  8,  9,  and 
10  are  presented  in  this  appendix.  The  appendix  is  divided 
into  five  sections,  corresponding  to  each  of  the  above  men¬ 
tioned  signals.  For  each  signal,  sample  estimations  and 
ensemble  performance  graphs  are  provided  for  different 
<^ZCR^  values.  The  ^ZCR^  value  corresponds  to  three 
categories  of  performance: 

(1)  Confident  reconstruction  of  the  entire  ensem¬ 
ble. 

(2)  Confident  reconstruction  of  only  a  portion  of 
the  ensemble  (i.e. ,  marginal  reconstruction  for  entire 
ensemble  with  reference  to  test). 

(3)  Questionable  reconstruction  of  most  or  all  of 
the  ensemble. 

These  three  categories  of  performance  occur  for  <  ZCR> 
values  of  18,  23,  and  26  for  all  the  signals  except  #3.  For 
signal  #3,  the  estimator  performance  is  questionable  for 
^ZCR^  =  23  and  marginal  for  a  ^ZCR^  value  greater  than 
18  and  less  than  23.  Since  the  estimator  performance  degrades 
rapidly  for  ^ZCR^  »18,  sample  estimations  for  ^  ZCR^  =  18 
and  <ZCR>  =  23  are  provided,  and  only  ensemble  performance 
curves  presented  for  <  ZCR  >  =  26. 


STATE  <* 1/32)  STATE  (*1/32) 

0  00  10.00  20.00  30  00  0.00  10.00  20.00  30  00 


FIGURE  85.  Sample  Estimation 
161 


"TfiTE  (*1/32) 

10  .00  20  .00  30  00 


164 


FIGURE  88.  Ensemble  Average  MSE  Performance 
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FIGURE  89.  Ensemble  Average  State  Error  Performance 


W  Cfl 


STATE  <*l/32>  STATE  <*l/32> 

,0.00  10.00  20.00  30.00  ^0.00  10.00  20.00  30.00 


ORIGINAL  STATE  SEQUENCE 


FIGURE  92.  S..mple  Estimation 


STATE  <*l/32>  STATE  Ul/32) 

0.00  10.00  20.00  30  .00  0 .00  10.00  20.00  30.00 


FIGURE  94.  Sample  Estimation 
1  70 


<r>  cn  ®  ® 
sO  N  O'  ♦ 
♦  10  • 
in  *  a 


00  003 


00  091  00  031  00  08  00  0> 

( 3M3101S )  <3SH> 


00  0 
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FIGURrJ  95.  linsemble  Average  MSB  Performance 


FIGURE  96.  EYisemble  Average  State  Error  Performance 


FIG  UR  rJ  97.  LYisemble  Average  MS  d  Performs 


FIGURE  98.  Ensemble  Average  State  Error  Performance 


FIGURE  99.  Sample  Estimation 
175 


STATE  < $1/32 )  STATE  <$l/32> 

0.00  10.00  20.00  30  .00  0 .00  10.00  20.00  30.00 


9.00  2.00  4.00  6.00  8.00  10.00 

TIME  (.  SEC  > 


ESTIMATED  STATE  SEQUENCE 


0  .00 


~T - 

2  .00 


—I - 1 - 1 - 1 - 

4  .00  6  .00  8  .00  10  .00 

TIME  <  SEC  > 


FIGURE  100.  Sample  Estimation 


Average  MS  E  Performance 


FIGUR K  105.  Ensemble  Average  State  Error  Performance 


STATE  <*l/32>  STATE  <*l/32> 

,0,00  10.00  20.00  30.00  Jd .00  10.00  20.00  30.00 


EST I  MATED  STATE  SEQUENCE 


FIGURE  107.  Sample  Estimation 
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STATE  (*1/32)  STATE  (*1/32) 

0  00  10.00  20.00  30.00  0 .00  10.00  20.00  30.00 


FIGURE  108.  Sample  Estimation 
184 


STATE  <*1/32 )  STATE  <*l/32> 

0  00  10.00  20.00  30.00  «0.  00  10.00  20.00  30.00 


ESTIMATED  STATE  SEQUENCE 


o 


00 


i 

2  00 


“ I - 1 - 1 - 1 - 

4  00  6  .00  8  00  10  00 

TIME  <  SEC  > 


FIGURE  109.  Sample  Estimation 
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STATE  <*l/32>  STATE  <*l/32> 

0^00  10  .00  20.00  30.00  0 .00  10.00  20.00  30.00 


1.00  2.00  4.00  6.00  8.00  10.00 

TIME  < SEC  > 


ESTIMATED  STATE  SEQUENCE 


T - 1 - 1 - 1 - 

4.00  6 .00  8 .00  10 .00 

TIME  <  SEC  > 


F'  itrs  1'  .  Sample  Estimation 
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8 

® 

* 


8 

35 

_  IN 


® 

8 


L® 


tu 

r 

_ 

s  *- 

® 
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® 

® 

* 


( ZtOidlS )  <3SW> 


N 

8 

8 

* 

N 

8 

* 

® 

N 

10 

* 

sO 

CO 

U> 

CO 

CO 

| 

• 

CM 

A 

A 

A 

UJ 

Ll 

8 

a 

A. 

H 

u. 

tu 

o 

u 

8 

_) 

N 

a. 

QC 

a 

0. 

V 

V 

V 

V 

z 

8 

8 

8 

N 

♦ 

CM 

CM 

10 

CO 

U. 

O 

Z 

Z 

H 

3 

CO 

oc 

0) 

Z 

X 

_l 

UJ 
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Ui 
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FIGURE  111.  Ensemble  Average  MS E  Performance 


DflTR  : 


.88 


FIGURE  112.  i]nsemble  Average  State  Error  Performance 


STATE  (t 1/32)  STATE  <*l/32> 

10.00  20.00  30.00  0.00  10.00  20.00  30  00 


1.00  2.00  4 . 00  6.00  8.00  10.00 

TIME  <  SEC  > 


ESTIMRTED  STRTE  SEQUENCE 


FIGURE  113.  Sample  Estimation 


STATE  (*1/32)  STATE  (*l/32> 

0.00  10.00  20.00  30.00  0.00  10  00  20  00 

'  J _  i  i  i  ®  i  ’ wv 


ORIGINAL  STATE  SEQUENCE 


PARAMETERS 

SIGNAL  # 

7 

RATE 

6365 

<  ZCR  >  25 

781 

SAMPLES 

640 

)  00  2 .00  4  00  6 .00 

TIME  (SEC) 


8  00 


10  00 


ESTIMATED  STATE  SEQUENCE 


0  00  2  00  4  00  6  00 

TIME  <  SEC ) 


8  .00 


10.00 


FlGURti  114.  Sample  Estimation 


STATE  (*1/32 >  STATE  (*1/32) 

0  00  10.00  20.00  30.00  0.00  10.00  20.00  30.00 


1.00  2  00  4  00  6.00  8.00  10.00 

TIME  <  SEC  > 


ESTIMRTED  STRTE  SEQUENCE 


8  00 


I - 

2  00 


“1 - 1 - 1 - 

4  00  6  00  8.00 

TIME  (SEC) 


~l - 

10  00 


FIGURE  115.  Sample  Estimation 
191 
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FIGURE  117.  Ensemble  Average  MSE  Performance 


FIGURE  118.  Ensemble  Average  State  Error  Performance 


STATE  <*l/32>  STATE  (*1/32) 

0.00  10.00  20.00  30.00  0 .00  10.00  20  .00  30.00 


FIGURE  119.  Sample  Estimation 
195 


STATE  <*1/32 )  STATE  <*l/32> 

0  00  10.00  20.00  30.00  ^0.00  10.00  20.00  30.00 


ESTIMATED  STATE  SEQUENCE 


.00 


2  .00 


“I - 1 - 

4  .00  6  .00 

TIME  <  SEC  > 


~! - 

8  .00 


“I - 

10  00 


FIGURE  120.  Sample  Estimation 
196 


STATE  <*l/32>  STATE  OH1/32) 

0.00  10.00  20.00  30.00  0 .00  10.00  20.00  30.00 


FIGURE  122.  Sample  Estimation 
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FIGURE  124.  Ensemble  Average  MSE  Performance 
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FIGURE  126.  Sample  Estimation 
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FIGURE  129.  Sample  Estimation 
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FIGUR  E  131.  Ensemble  Average  State  Error  Performance 
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FIGURE  132.  Sample  Estimation 
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FIGURE  135.  Sample  Estimation 
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FIGURE  137.  Ensemble  Average  MSE  Performance 
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FIGURE  139.  Sample  Estimation 
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FIGURE  141.  Sample  Estimation 
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FIGURE  142.  Sample  Estimation 
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FIGURE  143.  Ensemble  Average  MS K  Performance 
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FIGURE  145.  Sample  Estimation 
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FIGURE  147.  Sample  Estimation 
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FIGURE  149,  Ensemble  Average  MSE  Performance 
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FIGURE  150.  Ensemble  Average  State  Error  Performance 
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FIGURE  153.  Sample  Estimation 
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FIGURE  155.  Rnsemble  Average  MSF  Performance 


FIGURE  156.  Ensemble  Average  State  Error  Performance 
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FIGURE  157.  Sample  Estimation 
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FIGURE  158.  Sample  Estimation 
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FIGURE  160.  Sample  Estimation 
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FIGURE  161.  LYisemble  Average  Mo K  Performance 
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FIGURE  162.  Ensemble  Average  State  Error  Performance 
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FIGURE  164.  Sample  Estimation 
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FIGURE  166.  Ensemble  Average  MSE  Performance 
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FIG UR a  167.  Ensemble  Average  State  Error  Performance 
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FIGURE  169.  Sample  Estimation 
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FIGURE  170.  Sample  Estimation 
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FIGURE  171.  Sample  Estimation 
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FIGURE  172.  Ensemble  Average  MSE  Performance 


FIGURE  173.  Ensemble  Average  State  Error  Performance 


EXPANDED  TRELLIS : 


The  appendix  presents  the  expanded  trellis  diagram  used 
for  the  implementation  of  the  Viterbi  algorithm.  The  trellis 
of  Figure  16  describes  the  possible  state  transitions  of  the 
Markov  process  for  a  given  starting  state.  Connecting  paths 
( j,  1)  in  Figure  16,  exist  only  for  state  transitions  for 
which  pjxj(k) |x^(K-l)^  is  greater  than  zero.  Since  the 
branch  metric  of  equation  (53)  is  defined  by  taking  the 
natural  logrithm  of  the  transition  probability  values,  the 
zero  probability  of  a  given  transition  in  the  P  matrix  was 
replaced  by: 

Pi^  =  .000000000000001  |i-j|»l  (86) 

the  trellis  of  Figure  16  becomes  the  expanded  trellis  of 
Figure  174.  Each  state  represents  a  possible  pulse  position. 
The  solid  lines  represented  the  transitions  the  process  may 
actually  take.  The  dotted  lines  represent  the  transitions 
the  process  may  not  take,  but  now  exist  with  an  infintesimal 
probability  of  occurrence. 

It  is  necessary  to  note  that  the  "length"  of  the 
"illegal"  paths  is  very  long  when  compared  to  the  legal 
paths,  particularly  under  low  ^ZCR^  conditions.  Under 
high  ^ZCR^  ,  the  difference  in  path  length  reduces  as 
the  trellis  develops. 


